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CHAPTER  I 


INTRODUCTION:  THE  GENERAL  THEORY  OF 

DISTURBANCE-ACCOMMODATING  CONTROL 

1 . 1  Summary  of  Chapter  I 

This  chapter  discusses  general  aspects  of  the  theory  of 
disturbance-accommodating  control.  The  nature  of  dis¬ 
turbances,  the  distinction  between  noise  and  disturbances, 
and  categories  of  disturbances  are  considered.  A  general 
discussion  of  optimal  control  theory  for  the  control  problem 
with  disturbances  is  followed  by  presentation  of  an  approach 
to  optimal  control  in  the  case  where  the  disturbances  have 
"waveform  structure."  Finally,  the  theory  of  optimal 
control  for  the  linear-quadratic  regulator  with  disturbances 
is  introduced,  and  the  three  primary  modes  of  disturbance 
accommodation  are  discussed:  the  cancellation  mode,  the 
minimization  mode,  and  the  maximum  utilization  mode. 

1.2  Disturbances  in  Control  Problems?  Their  Nature  and 

Philosophies  of  Accommodation 

Controlled  systems  are  typically  subjected  to  uncon¬ 
trolled  inputs  arising  from  a  variety  of  sources.  These 
uncontrolled  inputs,  referred  to  as  disturbances,  usually 
occur  at  unpredictable  times  and  are  commonly  viewed  as 
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undesirable.  They  may  be  broadly  classified  as  either 
noise-type  disturbances  or  disturbances  with  waveform 
structure  11). 

Uncontrolled  inputs,  which  have  completely  erratic, 
random  characteristics  (i.e.,  no  significant  degree  of 
regularity),  are  classified  as  noise-type  disturbances. 
Thermal  noise  encountered  in  radar  and  radio  receivers  is  an 
example  of  a  noise-type  disturbance.  Disturbances  of  this 
type  are  often  modeled  by  their  statistical  moments  and 
spectral  density  properties.  The  fields  of  stochastic 
optimal  estimation  and  control  are  concerned  almost  entirely 
with  noise-type  disturbances,  and  several  texts  [21-14] 
provide  excellent  coverage  of  these  topics. 

On  the  other  hand,  many  uncontrolled  inputs  have  "wave¬ 
form  structure"  -  their  waveshape  is  describable  as  a 
weighted  combination  of  certain  known  basis  functions.  For 
example,  they  may  consist  of  weighted  linear  combinations  of 
steps,  ramps,  exponentials  or  other  functions,  even  though 
the  specific  values  of  the  weighting  coefficients  or  the 
times  at  which  they  change  value  may  be  unknown.  Such 
inputs  will  be  classified  as  waveform-type  disturbances. 

For  example,  wind  gusts  acting  on  a  missile  may  be 
classified  as  a  waveform-type  disturbance. 

A  further  classification  of  disturbances  may  be  made  by 
recognizing  waveform-type  disturbances  as  being  either 
natural  or  command  disturbances.  Some  examples  of  natural 


disturbances  are  wind  forces  on  aircraft,  fluctuating  loads 
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on  power  generators  and  drift  in  an  amplifier.  An  example 
of  a  command  disturbance  arises  in  connection  with  a  set- 
point  regulator  problem,  in  which  the  primary  control  task 
is  to  regulate  the  state  x(t)  to  a  given  set-point  x*.  Con¬ 
sider  the  usual  linear  state-variable  model  of  a  controlled 
system: 


x  =*  A  x  +  B  u  (1.1) 

where  x  is  the  state  vector,  A  is  the  "plant"  matrix,  B  is 
the  input  matrix,  and  u  is  the  control  vector  applied  to  the 
system.  The  "set-point  error"  is  defined  as  xe  *  x*  -  x 
and,  using  Equation  (1.1),  the  dynamics  of  xe(t)  are  found 
to  be  governed  by 

xe  *  A  xe  '  8  u  "  A  x*  (1.2) 

Therefore,  the  control  objective  in  terms  of  Equation  (1.2) 
is  to  regulate  the  error  state  xe  to  zero.  The  term  Ax* 
is  an  "uncontrolled"  input  and  thus  has  the  effect  of  a 
known  external  disturbance  in  the  model  Equation  (1.2).  It 
is  therefore  evident  that  a  controlled  system  represented  by 
the  conventional  model  Equation  (1.1)  fails  to  account  for 
the  presence  of  such  command  disturbances.  A  similar  dis¬ 
turbance  arises  in  the  servo-tracking  problem  associated 
with  Equation  (1.1)  wherein  a  prescribed  servo-command  func¬ 
tion  results  in  known,  time-varying  external  disturbances. 
Thus,  even  in  the  absence  of  "natural"  disturbances,  there 
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is  a  need  to  recount  for  command  disturbances  in  control 
system  models. 

Traditionally,  the  uncontrolled  inputs  associated  with 
control  system  design  have  been  viewed  as  being  detrimental 
to  the  task  of  the  control  system.  For  example,  in  clas¬ 
sical  control  system  design,  the  frequency  response  of  the 
overall  closed-loop  system  is  often  shaped  to  attempt  to 
filter-out  noise  and  disturbances,  while  maintaining  desired 
stability  and  accuracy  performance.  Classical  control  de¬ 
sign  approaches  have  resulted  in  such  design  schemes  as 
"integral  control",  "feedforward  control,"  and  the  notch 
filter  to  minimize  the  effects  of  noise  and  disturbances. 

On  the  other  hand,  there  are  practical  situations  in  which 
the  effects  of  disturbances  are  not  always  detrimental  to 
achieving  control  objectives.  For  example,  in  a  missile 
intercept  problem,  where  the  primary  control  objective  is  to 
drive  the  missile  so  that  the  position  of  the  missile  coin¬ 
cides  with  that  of  the  target,  wind  gusts  that  force  the 
interceptor  missile  to  move  in  the  direction  of  the  target 
may  be  constructively  used  to  aid  in  the  control  task.  In 
particular,  the  presence  of  the  wind  disturbance  may  actual¬ 
ly  reduce  the  interceptor  control  energy  and  the  time  re¬ 
quired  to  intercept  the  target.  The  concept  of  harnessing 
"free"  energy  from  winds,  tides,  etc.  has,  of  course,  been 
used  in  applications  other  than  control  systems,  and  will  no 
doubt  see  extensive  further  development. 
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The  application  of  modern  cont  :ol  theory  te-  .-iiques 
permits  the  consideration  of  three  modes  of  disturbance  ac¬ 
commodation: 

(a)  exact  cancellation  of  the  effect  of  the  disturbance 
on  the  control  system, 

(b)  the  "best"  approximation  to  cancellation  of  the  ef¬ 
fect  of  the  disturbance  (when  exact  cancellation  is  not 
achievable),  and 

(c)  optimal  utilization  of  the  disturbance  in  ac¬ 
complishing  the  control  objectives. 

In  addition,  combinations  of  these  three  modes  may  be 
used  in  particular  applications. 

The  theory  to  be  developed  in  the  present  study  assumes 
that  the  disturbances  might  not  be  directly  measurable.  In 
fact,  in  the  typical  case,  only  the  commands  and  the  plant 
output  y(t)  are  available  as  measurements  to  the  controller, 
where  y(t)  is  a  known  algebraic  function  of  time  and  the 
states  of  the  plant. 


1 . 3  Optimal  Control  of  Dynamical  Systems  in  the  Presence  of 
Disturbances;  A  General  Approach 

A  fundamental  difficulty  arises  when  an  optimal  control 
problem  is  formulated  to  include  uncontrolled  inputs  such  as 
disturbances.  Johnson  151  showed  that  the  standard  approach 
via  the  Pontryagin  maximum  principle  is  effective  only  if 
the  time-behavior  of  the  disturbance  function  is  entirely 
known  a  priori.  Unfortunately,  this  is  not  a  situation 
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enjoyed  in  practice,  since  the  behavior  of  disturbances  is 
almost  never  precisely  known  ahead  of  time. 

One  alternative  to  this  standard  optimal  control  ap¬ 
proach  is  the  stochastic-control  method,  which  treats 
disturbances  as  noise  and  utilizes  statistical  moments 
(mean,  covariance,  etc.)  to  characterize  the  disturbance 
time-behavior.  The  underlying  assumption  of  the  stochastic 
approach  is  that  all  disturbance  functions  with  the  same 
mean,  covariance,  etc.  are  modelled  alike,  ignoring  any  ad¬ 
ditional  information,  such  as  waveform  structure,  that  may 
be  available.  Statistical  moments,  such  as  the  mean  and  co- 
variance,  are  based  on  averages  over  relatively  long  time 
intervals.  High-performance  control  system  designs,  how¬ 
ever,  often  require  short-term  disturbance  behavior  patterns 
for  effective  operation.  For  example,  the  long-term  average 
value  wind-gust  forces  on  an  aircraft  may  be  very  close  to 
zero,  but  effective  control  of  the  aircraft  in  the  presence 
of  wind  gusts  requires  short-term  behavior  information  about 
the  disturbance.  The  characterization  of  disturbances  sole¬ 
ly  by  statistical  properties  is  justifiable  in  control 
system  design  only  when  no  waveform-mode  characterization  is 
possible;  that  is,  when  the  disturbance  is  essentially 
noise. 

1 . 4  Optimal  Control  in  the  Presence  of  Disturbances  Having 

Waveform  Structure  ” 

1.4.1  Disturbance  Modeling.  Johnson  ID  introduced 
the  concept  of  modeling  uncertain  waveform-type  disturbances 
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by  giving  a  differential  equation  that  the  disturbance  is 
known  to  satisfy.  The  uncertain  disturbance  is  described,  in 
this  approach,  as  a  linear  combination  of  functions: 


„(t)  -  ♦  Cjf2(t)  +  .  .  .  ♦  (1.3) 

where  the  coefficients  Cj_  are  piecewise  constant,  but  un¬ 
known,  and  the  functions  fjjt),  called  "basis  functions," 
are  known  functions  of  time  which  characterize  the  possible 
modes  of  the  disturbance. 

Suppose  that  the  differential  equation 


dpw 

dtp 


+  6o 


dp”1w 


dt 


P-1 


+  6. 


dw 

at 


B.w 


U)  (t) 


(1.4) 


(where  the  coefficients  dj  are  constants  and  u>(t)  i3  an 
impulsive  function  consisting  of  delta  functions,  doublets, 
etc.)  has  Equation  (1.3)  as  its  solution.  Then  the  effect 
of  ui(t)  will  be  to  cause  the  coefficients  C{  to  jump  in 
value  in  a  piecewise  constant  fashion  at  the  completely 
unknown  arrival  times  of  ui(t). 

As  an  example,  the  piecewise  constant  disturbance 

wx(t)  *  c  (1.5) 

where  c  is  unknown  and  changes  its  value  at  unknown  times  in 
a  piecewise-constant  fashion,  clearly  satisfies  the  differen¬ 
tial  equation 


dwi 

at 


p(t) 


(1.6) 
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where  o(t)  denotes  a  sparse  sequence  of  randomly  arriving 
impulses  which  cause  the  piecewise  constant  amplitude  of  the 
disturbance  w\jt)  to  change  to  a  new  value  every  once  in  a 
while. 

Similarly#  a  disturbance  consisting  of  a  linear  com¬ 
bination  of  constant  segments  and  linear  ramps: 

w2(t)  “  C1  +  c2fc  11.7) 


where  the  impulsive  sequence  u'(t)  consists  of  isolated  im¬ 
pulses  and  doublets  which  cause  the  and  c2  to  change 
at  unknown,  random  times. 

In  the  general  case,  the  basis  functions  fi(t), 

C^lt),  ...»  fm(t)  in  Equation  (1.3)  may  be  constants, 
ramps,  polynomials,  exponentials,  sinusoidal  terms,  etc. 

(and  linear  combinations  of  these),  corresponding  to  the 
mode  content  of  the  particular  disturbance  of  interest.  The 
modeling  approach  will  then  be  to  find  a  differential  equa¬ 
tion  of  the  general  form  as  Equation  (1.4)  which  has  the 
disturbance  w(t)  as  its  solution. 

This  approach  will  be  used  to  represent  realistic  dis¬ 
turbances  in  the  present  study.  It  will  often  be  useful  to 
view  the  disturbance  as  the  "output"  of  a  generally  non¬ 
linear  dynamic  process 
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z  =  '-/  (z,  X,  t)  +  o(t)  (1.9) 

w  =  <9t  ( z,  x,  t)  ,  t  -  t  -  T  (1.10) 

where  z  is  the  disturbance  "state"  vector,  x  is  the  plant 
state  vector,  w  is  the  disturbance  vector  and  a  is  a  vector 
whose  elements  are  sequences  of  impulse  functions.  The 
functions  0  and  <9t  are,  in  general,  time-varying,  non-linear 
and  may  involve  the  plant  state  x  (representative  of  a 
plant-dependent  disturbance  process).  Since  the  possible 
modes  of  the  disturbance  are  assumed  to  be  known  a  pr iori, 
the  functions  0  and  are  known,  but  the  vector  impulse 
sequence  a( t)  is  completely  unknown. 

In  the  case  of  the  disturbance  W2(t),  Equation  (1.7), 

(a  linear  combination  of  constant  levels  and  ramps  which 
satisfies  Equation  (1.8)),  the  disturbance  process  is  the 
linear  system 

z  =  D  z  +  a (t)  (1.11) 

w  =  H  z  (1.12) 


where  z  and  a(t)  are  2-vectors,  w  is  a  scalar  and  'u  and  H 
are  defined  by 


(1.13) 


H  -  [l  0] 


(1.14) 


It  should  be  noted  that  the  dynamic  process.  Equations 
(1.9)  and  (1.10),  seen  as  generating  the  disturbance  w(t), 
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is  a  fictitious  process.  Nevertheless,  the  actual  processes 
which  generate  typical  disturbances  such  as  wind  gusts,  load 
variations,  drifts,  and  biases  can  be  accurately  represented 
by  this  type  of  model. 

1.4.2  Optimal  Control.  The  state  model.  Equation 
11.9),  of  the  disturbance  process  can  be  combined  with  the 
typical  state  model  of  the  plant  dynamics,  resulting  in  the 
general  expressions 

x  ■  Jf  (x,  t,  u(t)  ,  *#(z,  x,  t))  (1.15) 

2  »  It  (2,  X,  t)  +  o(t)  (1.16) 

Johnson  has  shown  (51  that  the  optimal  control  u°,  which 
minimizes 

J  [u;  XQ,  tQ,  T j  »  G  (x  (T)  ,  T)  +  J  (L  (x  (t)  ,  t ,  u  (t)  )  dt  ( 1  •  1?  ) 
L  t 

o 

subject  to  the  combined  system  Equations  (1.15)  and  (1.16), 
and  assuming  o(t)  a  o  ,  can  be  expressed  as 

u°  =*  u°(x,  z,  t)  *  (1.18) 

That  is,  the  optimal  control  at  time  t  is  a  function  of  the 
current  state  x(t)  of  the  plant  and  the  current  state  z(t) 
of  the  disturbance.  This  result  may  be  contrasted  with  that 
obtained  by  the  conventional  optimization  approach,  which 


gives  the  optimal  control  as  a  function  of  the  plant  state 
xlt)  alone.  The  control  Equation  (1.18),  which  accounts  for 
the  presence  of  disturbances,  was  derived  under  the  as¬ 
sumption  that  the  impulse  sequence  o(t)  was  identically 
zero.  In  fact,  a( t)  is  sparsely  populated  and  unknown 
a  priori;  and,  therefore,  its  effect  could  be  viewed  as  a 
sequence  of  unknown  initial  conditions  z(t0)  imposed  on 
the  model  Equation  (1.16).  A  corollary  to  this  viewpoint 
(stated  as  a  conjecture  in  (5))  is  that  the  control 
u°(x,z,t)  given  by  Equation  (1.18)  is  "optimal"  also  for 
the  case  where  the  sparsely  populated  impulsive  sequence 

o(t)  is  present. 

Realization  of  the  control  law  Equation  (1.18)  requires 
that  real-time,  current  values  of  the  states  ( x,z )  be  made 
available  to  the  controller,  through  either  direct  measure¬ 
ments  or  use  of  an  observer.  A  discussion  of  the  imple¬ 
mentation  of  plant/disturbance  state  observers  may  be  found 
in  [1],  15],  16],  and  in  Appendix  A  of  this  dissertation. 

1 . 5  Optimal  Control  of  the  Linear-Quadratic  Regulator  with 

Disturbances 

1,5.1  The  System  Model.  A  special  case  of  the  optimal 
control  theory  discussed  in  Subsection  1.4.2  is  the  linear- 
quadratic  regulator  with  disturbances  present.  Johnson  has 
shown  in  11],  (5],  [6]  and  17}  how  the  disturbance  accom¬ 
modating  theory  applies  to  the  set-point  regulator  and 
servo-tracking  control  problems  in  which  the  plant  dynamics 
are  modeled  as: 
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X  -  A (t) x  +  B (t) u (t)  +  F ( t) w (t)  (1.19) 

y  ■  C(t)x  (1.20) 


where  x,  u  and  w  are  vectors  of  dimension  n,  r  and  p,  re¬ 
spectively,  and  n  _>  r  p.  The  disturbance  process  (1.9), 
(1.L0)  is  modeled  by  the  linear  system: 

w(t)  =  H(t)z  +  L(t)x  (1.21) 

z  =»  D ( t)  z  +  M (t)  x  +  cr  ( t)  (1.22) 

where  z  is  a p -dimensional  vector. 

1*5.2  The  Cancellation  Mode  of  Accommodation.  The 

of  regulating  the  state  x  to  a  set-point,  while  at¬ 
tempting  to  completely  cancel  the  disturbances  may  be  con¬ 
sidered  by  splitting  the  control  into  two  parts  [6] : 


u  =  u  + 
c 


UT 


(1.23) 


where  uc  is  the  control  required  to  perform  disturbance 
cancellation  and  ur  is  the  control  required  to  drive  x  to 
the  desired  set-point.  For  the  special  case  of  zero  state 
set-point,  the  control  objective  is  to  minimize  the  quadra¬ 
tic  functional 

T 

*  /  [xT(t)Q(t)x(t)  +  uRT(t)R(t)  uR(t)J  dt 


J(u) 


(1.24) 
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subject  to  the  terminal  condition  x(T)  «  0  and  to  the  plant 
dynamics  Equations  (1,19)  and  (1.20),  and  in  the  face  of  any 
possible  disturbance  w(t)  produced  by  Equations  (1.21)  and 
(1.22),  where  Q(t)  and  R(t)  are  known  positive-definite, 
symmetric  matrices  on  the  interval  [t0,  T) .  In  (1.24)  T  is 
the  terminal  time,  and  may  be  fixed  a  pr ior i  or  may  be 
unspecif ied . 

The  disturbance-accommodating  control,  if  it  exists, 
must  be  such  that  the  term  F(t)w  (t)  in  Equation  (1.19)  is 
exactly  cancelled  by  control  action  B(t)  uc(t).  That  is, 
the  required  control  component  uc  is  of  the  form 

uc  =  4>c  (x,t,w) 
where 

B (t) $  (x,  t,w)  +  P(t)w(t)  5  0  (1.25) 

C 

for  all  realizable  values  of  w(t)  3  Hz  +  Lx.  Equation 
(1.25)  can  be  satisfied  if,  and  only  if,  the  column  range 
space  of  F( t) (H( t) I L( t) )  lies  within  the  column  range  space 
of  B ( t ) .  That  is, 

F  ( t )  [h  ( t)  I  L(t)]i  B  { t )  T  { t)  (1.26) 

for  some  matrix  T (t),  or,  equivalently, 

Rank  £b  { t )  |  F  ( t )  ^H(t)  |L(t)J  j  =  Rank  [B(t)J,  tQ  <  t  <  T  (1.27) 

If  Equation  (1.26)  is  satisfied,  then  Equation  (1.25)  can  be 
satisfied  by  choosing 
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uc  ■  4>c(x,  t,  w)  «  -  r(t)^-|-y  (1.28) 

such  that  complete  cancellation  of  the  disturbance  is  ob¬ 
tained.  Substituting  Equations  (1.23)  and  (1.28)  into  Equa¬ 
tion  (1.19)  then  gives 

x  *  A (t) x  +  B(t)uR(t)  (1.29) 

Conventional  linear-quadratic  regulator  theory  for  the  re¬ 
duced  problem  Equation  (1.29)  (for  example,  see  Athans  and 
Falb  [8] )  gives  the  optimal  control  ur  for  Equations 
(1.24)  and  (1.29)  in  the  familiar  state-feedback  form 

uR(t)  »  K(t)x(t)  (1.30) 

where  the  feedback  gain  matrix  K(t)  satisfies  a  particular 
matrix  Riccati  differential  equation.  The  complete  control 
u°  is  the  superposition  of  Equations  (1.28)  and  (1.30): 

u°(x,  z,  t)  ■  J^K(t)  ”  r2 (t)]  x  -  r^ft)  z  (1.31) 

where  T  »  ^1|r2j 

Implementation  of  this  optimal  control  law  employs  an 

A  A 

estimator  to  generate  estimates  x  and  z  of  the  states  x  and 
z  from  measurements  of  the  output  y.  Johnson  lias  shown  [5] 
that  these  estimates  may  be'  obtained  from  the  composite 
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estimator  described  by 


where  the  matrices  K^(t)  and  K2(t)  are  chosen  to  make 
the  estimation  error 


settle  toward  zero  quickly  between  arrival  times  of  the 
isolated  impulses  of  o(t).  The  term  y  in  Equation  (1.32) 
represents  the  measurement  of  the  output  of  the  actual 

A  A 

plant,  and  x  and  z  are  the  resulting  on-line,  real-time 
estimates  which  are  then  used  in  the  implementable  control: 

uQ  (x,  z,  t)  -  £k  ( t )  -iyt)J  x  -T^t)  z  .  (1.34) 

The  resulting  controller  is  called  a  "disturbance-absorbing 
controller"  and  has  interesting  features  which  may  be  com¬ 
pared  with  results  from  classical  design  approaches.  For 
the  case  of  a  piecewise  constant  disturbance,  a  propor¬ 
tional-plus-integral  controller  is  obtained  from  Equa¬ 
tion  (1.34);  for  disturbances  that  are  represented  by 
higher-order  polynominals,  multiple-integral  feedback 
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structures  are  obtained.  In  the  case  of  sinusoidal  dis¬ 
turbances,  with  completely  unknown  phase  and  amplitude,  ex¬ 
pression  Equation  (1.34)  produces  the  classical  notch-filter 
effect  for  the  closed-loop  system. 

1.5.3  The  Minimization  Mode  of  Accommodation.  Complete 
cancellation  of  the  effects  of  the  disturbance  on  the  plant 
dynamics  may  not  be  possible  -  it  may  be  mathematically  im¬ 
possible  to  find  a  T(t)  satisfying  Equation  (1.26).  If  this 
is  the  case,  then  uc(t)  may  be  chosen  to  minimize  the  ef¬ 
fects  of  the  disturbance  on  the  plant  behavior,  in  some  spe¬ 
cified  sense.  One  approach  is  to  minimize  the  norm 

| | B (t) u  +  F (t) w (t) | |  .  (1.35) 

c 

The  vector  uc  which  minimizes  Equation  (1.35)  is  not 
unique,  in  general;  but,  if  one  chooses  the  u°c  which 
itself  has  minimum  norm,  then  that  u°c  is  unique,  and  is 
given  by 

u°  =  -B*(t)F(t)w(t)  (1.36) 

C 

where  B*(t)  is  the  Moore-Penrose  generalized  inverse  of 
B ( t )  (6],  [9].  If  the  rank  of  B  is  equal  to  r  (the 
dimension  of  the  control  u°c) ,  then  B#  has  the  specific 
form 

B#(t)  *  £bT  ( t )  B  ( t )]  BT  ( t)  (1.37) 


--^.AuKA.,  -  .  -f- f 
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The  implementation  of  the  control  Equation  (1.36)  requires 
on-line,  real-time  estimates  of  x  and  z;  and  the  modified 
composite  state  observer  equations  are  described  in  [6] . 

The  computation  of  UR(t)  is  performed  as  for  the  case  of 
complete  cancellation. 

1.5.4  The  Maximum  Utilization  Mode.  Disturbances  are 
not  necessarily  detrimental  to  the  achieving  of  control  sys¬ 
tem  objectives.  Although  numerous  approaches  have  been  de¬ 
veloped  for  cancelling  or  minimizing  disturbances,  the  idea 
of  utilizing  disturbances  in  control  systems  is  a  relatively 
recent  development  [1],  [5],  [61,  [7].  Constructive 
utilization  of  disturbances  can  lead  to  reduced  control  en¬ 
ergy  and  reduced  time  required  to  bring  the  plant  state  to  a 
required  set-point  objective.  Likewise,  in  servo-tracking 
problems,  disturbances  may  be  constructively  utilized  to 
assist  the  control  in  guiding  the  plant  output  y(t)  to 
faithfully  "follow"  a  time-varying  command  function  yC(t)* 

Maximum  utilization  of  a  disturbance  w(t)  having  wave¬ 
form  structure  can  be  achieved  by  employing  optimal  control 
theory  to  design  the  controller.  Although  this  is  virtually 
impossible  using  classical  control  system  design  approaches, 
it  is  relatively  straightforward  with  modern  optimal  control 
theory.  The  key  to  obtaining  maximum  utilization  of  dis¬ 
turbances  is  to  choose  a  performance  index  J  so  that,  when  J 
is  minimized  with  respect  to  the  control  u(t),  the  primary 
control  objective  is  accomplished  and  maximum  use  of  the 
disturbance  w(t)  is  achieved.  For  example,  if  the  primary 
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control  objective  is  to  regulate  the  plant  state  x(t)  to 
zero,  a  secondary  objective  may  be  to  use  as  little  control 
energy  as  possible.  One  may  be  able  to  achieve  these  ob¬ 
jectives  by  choosing  a  quadratic-type  performance  index  as 


1 

7 


xT(T) 


Sx (T)  + 


>/[’ 


xT(t) 


Qx  (t)  +  u*  (t)  Ru  (t)J  dt  (1.38) 


where  S  and  Q  are  given  symmetric  non-negative  definite 
matrices.  S  +  Q  is  positive  definite,  R  is  a  positive- 
definite  matrix,  and  the  terminal  time  T  is  specified.  Note 
that,  in  this  design,  the  control  u(t)  is  not  split  into 
components  as  was  the  case  in  Equation  (1.23).  The  presence 
of  the  positive  definite  matrix  R  encourages  the  effective 
utilization  of  any  "free"  energy  available  in  the  disturb¬ 
ance.  This  approach  was  used  for  a  special  application  in 
linear  systems  in  the  work  of  Johnson  and  Skelton  [13],  and 
was  subsequently  generalized  in  the  work  of  Johnson  [6] . 

In  the  next  chapter  it  will  be  seen  that  the  disturbance 
utilizing  problem  can  be  formulated  as  a  linear-quadratic 
regulator  problem  by  using  the  augmented  vector 


x 


(1.39) 


which  is  a  composite  of  the  state  vectors  of  the  plant  and 
the  disturbance  process.  The  composite  system  equation  may 
be  written  by  using  x  and  the  plant  and  disturbance  dynamic 


Equations  (1.19),  (1.21)  and  (1.22),  with  L(t)  *  0,  as  fol¬ 
lows: 
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(1.40) 


The  performance  index  Equation  (1.38)  can  be  written  in  the 
equivalent  form 

T 

1%  1  /*  R  m  T  1 

J  -  jX(T)Sx(T)  +  j  /  x  (t)QX  (t)  +  u  (t)Ru(t)  dt  (1.41) 

t 

o 

where  S  ■  CTSC,  C  -  (-CIO]  and  Q  ■  CTQC.  It  will  be 
seen  in  Chapter  II  that  the  sparse  sequence  of  impulses  a(t) 
can  be  disregarded  and  the  control  which  minimizes  Equation 
(1.41)  subject  to  Equation  (1.40)  can  be  found  using  stan¬ 
dard  linear-quadratic  methods,  resulting  in  the  control 


1  T 
-R  B* 


K  X  +  K  Z 1 
Lx  xz  J 


(1.42) 


which  is  a  function  of  the  states  of  the  plant  and  of  the 
disturbance  process.  It  will  also  be  seen  that  the  time 
varying  gain  matrix  Kx(t)  is  the  familiar  gain  term  ob¬ 
tained  as  the  solution  of  a  certain  matrix  Riccati  equation, 
as  in  the  standard  linear-quadratic  regulator  problem.  The 
time-varying  gain  matrix  Kxz  will  be  found  as  the  solution 
of  a  certain  linear  matrix  equation  which  depends  upon  Kx 
and  the  parameters  of  the  plant  and  disturbance  processes. 
The  derivation  and  properties  of  Kx,  Kx2  and  additional 


ii 
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matrices  associated  with  the  more  general  non-zero  set-point 
and  servo-tracking  problems  will  be  further  examined  in  the 
next  chapter. 


CHAPTER  II 


DISTURBANCE -UTILIZING  CONTROL;  GENERAL 
THEORY  FOR  LINEAR-QUADRATIC  PROBLEMS 

2 . 1  Summary  of  Chapter  II 

This  chapter  presents  a  general  theory  for  disturb¬ 
ance-utilizing  control  in  the  case  of  linear-quadratic  re¬ 
gulator  and  servo-tracking  problems.  A  description  of  the 
linear-quadratic  regulator  and  servo-tracking  control  prob¬ 
lems  is  given,  followed  by  a  discussion  of  the  control  ob¬ 
jectives,  problem  formulation,  and  general  solution  of  these 
problems  in  the  context  of  disturbance-utilizing  control. 

The  computational  and  dynamic  properties  of  the  disturbance¬ 
utilizing  control  law  are  discussed  in  terms  of  its  general 
behavior,  steady-state  solutions  and  methods  for  determining 
steady-state  values.  The  concepts  of  burden,  assistance  and 
utility  are  presented  and  the  properties  of  the  utility 
function  and  domains  of  positive  uu:lity  are  examined  in 
detail . 

2 . 2  Description  of  the  Linear-Quadratic  Regulator  and 

Servo-Tracking  Control  Problems 

The  concept  of  achieving  maximum  utilization  of  a  dis¬ 
turbance  by  employing  optimal  control  theory  in  the  control¬ 


ler  design  was  introduced  in  the  previous  chapter.  The 
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specific  cases  of  obtaining  maximum  utilization  of  a  dis¬ 
turbance  in  linear-quadratic  regulator  and  servo-tracking 
control  problems  will  now  be  described.  The  approach  will  be 
demonstrated  by  considering  a  specific  example  using  the 
linear  system  model 

x  =  A ( t ) x  +  B ( t) u  (t)  +  F ( t )  w(t)  (2.1) 

y  =  C (t) x  (2.2) 

where  x,  u  and  w  are  n™,  r-,  and  p-vectors,  respectively, 
and  n  >_  r  >_  p.  The  disturbance  process  will  be  assumed  to 
be  a  special  case  of  the  model  of  Equations  (1.21)  and 
(1.22)  with  L(t)  =  0  and  M(t)  =  0: 

w(t)  *  H(t)z 
z  -  D  (t)  z  +  a  (t) 

2 . 3  The  Objectives  of  Disturbance-Utilizing  Control 
Strategy 

The  primary  objective  of  control  is  assumed  to  be 
either: 

(a)  regulation  to  a  given  state  set-point  xSp  or  a 
given  output  set-point  ysp,  or 


(2.3) 

(2.4) 


(b)  servo-tracking  of  a  given  state  or  output  servo- 
command  function  xc(t)  or  yc(t). 

The  secondary  control  objective  is  to  achieve  the  prim¬ 
ary  objective  while  minimizing  the  control  energy  as¬ 
sociated  with  u(t).  Control  energy  is  assumed  to  be  mea¬ 
sured  by  the  time-integral  of  the  quadratic  form 
uT(t)R(t)u(t) ,  when  R(t)  is  a  given  symmetric,  positive- 
definite  matrix. 

These  control  objectives  may  be  achieved  [7]  by  con¬ 
sidering  the  quadratic  performance  index 

T 

J  -  ieT(T)Se(T)  +  i  J'  [eT  (t)  Q  ( t)  e  ( t)  (2.5) 

•f* 

"o 

+  u* ( t) R (t)  u  (t)J  dt 

where  S  and  Q(t)  are  given  symmetric  non-negative  definite 
matrices,  S  +  Q  is  positive  definite,  the  terminal  time  T  is 
given  and,  e  =  yc(t)  ~  y(t)  (or  ySp  -  y(t)).  The  case 
of  state  set-points  or  state  servo-commands  may  be  consider¬ 
ed  by  setting  C  =  I  in  Equation  (2.2).  The  control  objec¬ 
tive  is  achieved  by  minimizing  J  with  respect  to  the  control 
u(t),  subject  to  the  plant  and  disturbance  Equations  (2.1)- 
(2.4). 

The  set  of  expected  servo-commands  yc(t)  or  set-points 
ySp  are  modeled  by  the  equations 
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y  (t)  »  Git)  c  (  2 .  b  )  I 

c 

c  -  E(t)c  +  lilt)  (2.7) 

where  y-  is  an  m-vector,  c  is  the  v  by  1  state  vector  ot  > 

the  set-point  or  ser vo-command  process,  c(t0)  is  arbitrary  , 

and  u  ( t )  is  a  sparse  sequence  of  impulses.  If  set-points 
are  beinq  considered,  yc  should  be  set  equal  to  ysp,  a 
piecewise  constant  function,  and  E(t)  will  be  identical¬ 
ly  zero.  Eor  the  case  of  servo  trackinq  or  set-point  req- 
ulation,  the  fundamental  necessary  condition  for  perfect 
set-point  or  servo  trackinq,  o(t)  a  0,  is  that  the  "track- 
ability  condition"  C(t)  *  C(t)0(t)  be  satisfied  for  some 
0 (t)  (see  references  (10],  (111,  (12],  (371). 

2 . 4  formu lat ion  of  the  D  i  s turbance-U 1 1 1 izat ion  Optimal 
Control  Problem 

In  this  controller  desiqn  approach,  the  control  u  (t) 
is  not  split  as  it  was  in  Equation  (1.23).  The  presence  ot 
the  positive  penalty  term  u  l'(  t )  K(  t )  u  ( t )  in  the  inteqrund 
ot  the  performance  index  Equation  (2.5)  encouraqes  the 
maximum  utilization  ot  the  "tree  enerqy"  of  the  disturbance 
w(t)  while  achievinq  the  primary  control  objective  ot 
set-point  requlation  or  servo-track inq .  The  disturbance 
utilization  1  i near-quadrat ic  optimal  control  problem  is 
formulated  (tor  example,  see  Reference  17])  by  usinq  the 


a uq men ted  vector 
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(2.8) 


which  is  a  composite  of  the  state  vectors  of  the  plant,  the 
set-point  or  servo-command  process,  and  the  disturbance 
process.  The  composite  system  equation  may  be  written  by 

-NJ 

using  x  and  Equations  (2.1),  (2.4),  and  (2*7)  to  obtain: 


/  *  \ 

A 

0 

FH 

B 

/o\ 

f  i  J 

6 

E 

0  _ 

X  4- 

0 

u  -i 

q  H  1 

0 

0 

D 

0 

\  o  f 

(2.9) 


The  performance  index  Equation  (2.i>)  can  be  written  in  the 
equivalent  form 


J  -  ixT(T)5x(T)  + 


J|> 


xT(t)0(t)  x  (t)  +  uT(t)  R(t)u(t)  d  t  {  2 . 1 0  ) 


where  S  ■  d'lSC,  C  »  l-C|d  1 0 1  and  0  ■  C^\)C . 

For  reasons  discussed  in  Reference  (bl,  the  sparse  se¬ 
quences  of  impulses  c(t)  and  u(t)  in  Equation  (2.9)  may  be 
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disregarded,  and  the  solution  of  Equations  (2.9)  and  (2.10) 
can  be  found  using  standard  linear-quadratic  optimal  control 
methods.  The  optimal  disturbance-utilizing  control  is  the 
control  u°(t)  which  minimizes  Equation  (2.10)  subject  to 
the  dynamic  Equation  (2.9). 

2 . 5  General  Solution  of  the  Disturbance-Utilization 
Optimal  Control  Problem 

The  minimization  of  the  performance  index  J  Equation 
(2.10)  subject  to  the  composite  dynamic  system  Equation 
(2.9)  can  be  accomplished  by  using  the  Hamilton-Jacobi  the¬ 
ory  [4],  (8].  If  we  define  the  special  function  V(x,t)  to 
be  the  value  of  the  performance  index  J  when  the  optimal 
control  u°(t)  is  employed,  i.e. 

V(x,  t)  =*  J(u°;  x,  t,  T)  ;  x(tQ)  *  x  tQ  *  t  (2.11) 


it  can  be  shown  that  the  function  V(x,t)  satisfies  the 
Hamilton-Jacobi-Be liman  partial  differential  equation 


+  VM/TAx  -  hVM/TBR~1BTV'W  +  %XTQx  =  0 

at  XXX 


(2.12) 


subject  to  the  boundary  condition 
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,'V<  1\,T—  'Vi 

V(x,  T)  =  JX  Sx 


(2.13) 


where  Q  and  S  have  already  been  defined,  and  A  and  B  are  de¬ 
fined  by 


A 

0 

FH 

A  = 

0 

E 

0 

0 

0 

D 

(2.14) 


B 


_B_ 

0 


(2.15) 


and 


av 

.-V 


N 


n  +  v  +  p 


<2.16) 

It  may  be  shown  [81  that,  if  u(t)  is  not  constrained,  T  is 
specified,  S  and  Q(t)  are  non-negative  definite,  S  +  Q  is 
positive  definite  and  R(t)  is  positive  definite,  then  an  op¬ 
timal  control  exists  and  is  given  by 


u°  (t) 


-R-1(t)BT(t)V%V 

x 


(2.17) 


The  sought  solution  of  the  Hamilton-Jacobi-Bellman  Equation 
(2.12)  can  be  expressed  as  the  symmetric  non-negative  de¬ 
finite  quadratic  form 


k. 


V(x,  t)  =  |xTP(t)x 


(2.18) 


where  P(t)  =  PT(t)  >  0  is  chosen  to  satisfy  Equation 
(2.12).  For  mathematical  simplification,  it  is  convenient 
to  partition  P  as  the  3x3  block  matrix: 


rKx(t) 

Kxc(t) 

K  (t)' 

xz 

p  = 

K  T(t) 
xc 

Kc(t) 

IWt) 

K  T(t) 
xz 

T 

Kcz  (t) 

Kz(t) 

;  P  (T)  =  S 


(2.19) 


where  the  dimensions  of  the  component  matrices  are  denoted 
as  follows:  r  ~\  r  *1  T  1 


H  -•  M 1 W  •• 

nxn  nxv  nxp 

M  'H  ’[*«] 


vxn  vxv 


[k-t]  M  *[«.] . 


(2.20) 


pxn  pxv  pxp 

Now  if  Equations  (2.18)  and  (2.19)  are  substituted  in 
the  Hamilton-Jacobi-Bel lman  Equation  (2.12),  the  result  is  a 
set  of  six  unilaterally  coupled  matric  differential 
equations  which  determine  the  individual  blocks  K^j  of  the 
partitioned  matrix  P.  Those  equations,  with  their  specific 
terminal  conditions  are  as  follows: 
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• 

Kx  58 

—  It  t 

(-A  +  BR  BAKx) lKx  - 

KxA  ' 

T 

C  QC 

;Kx(t)  * 

CTSC  (2.21) 

• 

K.  = 

-IT  T 

(-A  +  BR  BaKJ  K 

-  K  E 

+  ctqg 

;K  (T)  * 

-CTSG  (2.22) 

xc 

X  xc 

xc 

'  XC 

'xz  “ 

(“A  +  BR~1BTKx)TKx2 

-  KXFH 

-  KxzD 

!Kxz(T> 

*  0  (2.23) 

K  =  -  (KE  +  ETK  )  +  K  ^TBR_1BTKv „  -  GTQG  ?K  (T)  =  GTSG(2.24) 
c  c  c  xc  xc  c 

*CZ  -  -(KC2D  +  eTKOZ»  +  KXOT(BR'1bTKXZ  -  FH»>KCZ'T»  “  °<2-25' 

KZ  =  -<V  +  o\)  *  kx2tbr-1btkxz  -  [(FH)TKX2  +  kx2tfh] 

(2.26) 

;rz(t)  =  o 

These  equations  are  independent  of  the  initial  conditions  on 
the  plant,  disturbances,  and  commands,  and  can  be  solved  by 
integrating  in  backward  time,  starting  at  t  =  T  and  "advanc¬ 
ing"  to  t  ■  tQ. 

Finally,  using  the  fact  that  V£V  ■  Px,  and  sub¬ 
stituting  this  relation  in  Equation  (2.17),  the  optimal 
disturbance-utilizing  control  is  obtained  as 

u°  -  -R'V  [kxx  ♦  Kxcc  +  Kx2z]  .  (2.27) 


Note  that,  for  the  zero  set-point  regulator  with  no  dis¬ 
turbances  present,  Equation  (2.27)  reduces  to  the  form 
familiar  from  the  solution  of  the  "conventional"  linear- 
quadratic  zero  set-point  regulator  problem 


U°  =  -R_1BTKxX 


(2.28) 


in  which  Kx  is  the  solution  of  Equation  (2.21),  a  matric 
Riccati  differential  equation;  (for  example,  see  [8]): 

As  in  the  other  modes  of  disturbance  accommodation,  a 


composite  state  reconstructor  will  be  used  to  provide  es¬ 
timates  of  x,  c,  and  z  for  implementation  of  the  control  law 
Equation  (2.27). 

2.6  Computational  Features  and  Dynamic  Properties  of  the 
Disturbance-Utilizing  Control  Law 

2.6.1  Behavior  of  the  Riccati/Linear  System  of 


Matric  Differential  Equations.  The  behavior  of  the 
disturbance-utilizing  optimal  control  law  Equation  (2.27) 
depends  on  the  values  of  the  time-varying  gain  matrices 
KX(T),  Kxc(t)  and  Kxz^t^»  which  are  the  solutions  of 
the  differential  Equations  { 2 . 21 )- ( 2 . 23 ) ;  therefore,  a  study 


of  these  solutions  is  appropriate. 


Results  from  the  "conventional"  linear-quadratic  reg¬ 
ulator  problem  (i.e.,  with  no  disturbances  present)  apply  to 


the  solution  of  Equation  (2.21)  (see  Reference  (8]).  That 
is,  if  S  and  Q(t)  are  non-negative  definite,  T  is  specified, 
and  R(t)  is  positive-definite,  then  Equation  (2.21)  has 
Kx(t)  as  its  unique  n  x  n  positive-definite  solution. 

This  equation  is  completely  uncoupled  from  the  others,  and 
so  it  can  be  solved  independently  for  Kx(t).  Note  that 
Equations  (2.22)  and  (2.23)  each  depend  on  Kx(t),  ex¬ 
hibiting  a  unilateral  coupling. 

Since  the  boundary  condition  for  each  equation  is  given 
at  the  terminal  time,  t  *  T,  the  equations  must  be  solved  in 
backward  time.  By  making  the  substitution 

T  -  T  -  t  (2.29) 

in  Equations  (2. 21)- (2. 23) ,  where  (T  -  tQ)  >  t  >.0,  the 

following  "backward  time"  equations  are  obtained  (here  (*)  * 

d/dx ) : 

Kx  »  (A  -  BR"1BTKx)TKx  +  KxA  +  CTQC  ;Kx(0)  “  CTSC  (2.30) 
Kxc  -  (A  -  BR“1BTKx)TKxc  +  KXCE  -  CTQG  ;KX(,(0)  --CTSG(2.31) 

Kx,  -  (A  -  BR~1BTKx)TKxz  +  KXFH  +  KXZD  ;KXZ(0)  -  0  (2.32) 

These  differential  equations  are  readily  solved  numerically, 
using  digital  computer  numerical  integration  routines,  such 


as  second-order  or  fourth-order  Runge-Kutta,  to  obtain 
Kx(t) ,  Kxc(t) ,  and  Kxz(t)  gain  histories  for  the 
optimal  control  law  Equation  (2.27)  over  the  total  control 
interval  tQ  <_  t  <_  T.  The  remaining  three  equations, 

( 2 . 2 4 )  —  ( 2.26) ,  do  not  enter  into  computation  of  the  optimal 
control  law;  but  the  latter  two  Equations,  (2.25)  and 
(2.26),  along  with  Equation  (2.23),  have  important  effects 
on  state  space  domains  in  which  positive  disturbance 
utilization  is  possible.  This  topic  is  considered  in 
Section  2.8  of  this  chapter. 

2.6.2  Existence  of  Steady-State  Equilibrium 
Solutions  of  the  Riccati/Linear  System.  The  special  case  in 
which  the  matrices  A,  B,  C,  D,  E,  F,  G,  H,  Q,  R  and  S  are 
all  constant  matrices  is  important  in  practical  applications 
and  can  be  analytically  studied  somewhat  further  than  the 
time-varying  case.  The  existence  of  steady-state  solutions 
of  the  matric  differential  Equations  (2.21)-(2.26)  as  T-*-00 
will  now  be  examined  for  the  constant  case. 

2. 6. 2.1  Existence  of  a  Steady-State  Solution  Kv . 
The  standard  linear-quadratic  optimal  control  problem  is 
concerned  with  the  task  of  finding  the  optimal  control  u° 
to  minimize  a  quadratic  performance  index  Equation  (2.5) 
subject  to  an  undisturbed  linear  state  model 
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x  =  Ax  +  Btt  " 
y  =  Cx 

The  non-negative  definite  matrix  Q  in  the  performance  index 
Equation  (2.5)  can  always  be  expressed  as  [14] 


(2.33) 

(2.34) 


Q  = 


(2.35) 


for  some  unique  matrix  H]_ .  If  the  matrix  pair  [A,  H]J 
is  completely  observable  and  the  matrix  pair  [A,  B]  is  com¬ 
pletely  controllable,  then  it  can  be  shown  [15]  that,  for 
the  time  invariant  problem,  as  T -*■*>,  the  solution  Kx(t)  of 
the  matric  Riccati  Equation  (2.30)  is  uniformly 
asymptotically  stable  to  a  well-defined  matrix  Kx 


lim  Kx(t)  *  Kx  (2.36) 

J  -►00 

where  Rx  is  the  unique,  positive-definite  solution  of  the 
so-called  matric  algebraic  Riccati  equation 


(A  -  BR_1BTKx)TKx  +  KXA  +  CTQC  -  0  (2.37) 

The  composite  system  described  by  Equation  (2.9),  how¬ 
ever,  is  not  completely  controllable,  since  the  control  u(t) 
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has  no  effect  on  the  disturbance  z  or  the  set-point/servo- 
command  state  c.  Thus,  the  aforementioned  sufficient  con¬ 
ditions  for  the  existence  of  a  steady-state  solution  are  not 
met  by  the  augmented  matrix  P  (Equation  (2.19)). 

An  alternative  approach  [16]  to  the  problem  of  existence 
is  to  partition  the  composite  system  equations  into  a  com- 
letely-controllable  (c.c.)  part  and  a  totally  uncontrollable 
part.  Then  the  conditions  on  the  existence  of  steady-state 
value  of  gain  will  apply  to  the  c.c.  part.  For  this 
purpose,  the  composite  matrices  A  and  B  will  be 
-e-partitioned  as 

A  a 

where  the  following  identifications  are  made: 


(2.39) 

(2.40) 

(2.41) 

(2.42) 


It  is  observed  that  Equation  (2.30)  is  the  Riccati  equa¬ 
tion  for  the  auxiliary  problem  with  system  equation 


\ 

I 


f  - 


F 


s 


i 
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XI  =  A1  XI  +  B1  u  (2.43) 

y  =  C  xr  (2.44) 


where  the  composite  vector  x  has  been  repartitioned  as 


a. 

x 


where 


x 


I 


x 


X 


II 


(2.45) 


(2.46) 


Now,  if  the  matrix  pair  (A]_ ,  HjJ  is  completely  ob¬ 
servable  and  the  matrix  pair  [A^ ,  b^]  is  completely  con¬ 
trollable,  then  as  T  the  matric  Riccati  differential  Equa¬ 
tion  (2.30)  has  a  solution  which  approaches  a  unique,  con¬ 
stant,  positive-definite  value  Kx,  and  furthermore,  Kx 
is  the  unique,  positive  definite  solution  of  the  associated 
matric  algebraic  equation  (2.37). 

The  inclusion  of  the  condition  that  the  matrix  pair 
l Ai ,  H^]  be  completely  observable  ensures  that  the 
eigenvalues  of  the  closed-loop  matrix 


Acl  =  (A  -  BR~1BTKx) 


(2.47) 


will  have  negative  real  parts  [15,  17;  pp.  39-43],  even 
if  the  original  open-loop  system  is  unstable.  (The 


*  aw*1.' ^-“WfiTflrny 
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condition  on  [A^ ,  HjJ  has  the  effect  of  ensuring  that 

the  elements  of  the  state  vector  x  are  all  "observed"  by  the 

performance  index  J). 

2. 6. 2. 2  Existence  of  a  Steady  State  Solution 
luce  •  /ihe  conditions  for  the  existence  of  Kx  are  met, 

then  as  '':•*■<*> ,  Equation  2.31  may  be  written 

i 

Kxc(T)  *  ACLTkxc(t)  +  Kxc(T)  E  '  cTqG?  Kxc{0)  ="cTsg  <2-48> 

Equation  (2.48)  may  be  rewritten  as  the  equivalent  vector 
differential  equation  ([20],  Chapter  12) 


kxc(T)  *  Axckxc(T)  “ 


xc' 


kxc(0)  -  k0xc 


(2.49) 


where  kxc  is  now  a  (nvx  1)  vector  whose  elements  are  the 
elements  of  the  (n  by  v)  matrix  Kxc.  Similarly,  cxc  is 
a  (nv  by  1)  vector  whose  elements  are  the  elements  of 

CtQG ,  and  xqxc  is  the  (n  v  by  1)  initial-condition  vector 
whose  elements  are  the  elements  of  -CTSG.  The  matrix 

Axc  is  the  (nv  by  nv)  square  matr ix  defined  by  the 
Kronecker  sum 


xc 


ACL  *  Xv 


+  I  X  E4 
n 


E- 


(2.50) 
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which  is  the  sum  of  two  Kronecker  products.  Recall  that 
Acl  is  an  (n  by  n)  matrix  and  E  is  a  (v  x  v)  matrix. 

Since  Equation  (2.49)  is  equivalent  to  Equation  (2.48), 
the  stability  of  Equation  (2.48)  is  determined  by  the 
eigenvalues  of  Bellman  {[20]  ,  p.  230)  shows  that  the 

eigenvalues  of  the  Kronecker  sum 


Aj.  =  Aq  XI  +  I_  XB_ 


n  o 


(2.51) 


are 


■w  +  w: 


i  =  1,  2,  ...,  n  ;  j=l,  2,  ...  v 


(2.52) 


where  A  is 
o 

matrix ,  the 
eigenvalues 
eigenvalues 
termine  the 


an  (n  by  n)  matrix  and  Bq  is  a  (  v  by  v) 

eigenvalues  of  Aq  are  A^(AQ)  and  the 

of  Bq  are  A  ^ (BQ) .  Using  the  fact  that  the 
T 

of  E  and  of  E  are  identical,  we  may  thus  de¬ 
eigenvalues  of  Axc  by 


Ai  <ACL)  +  A.  (E) ; 

i  =  1,  2,  ...  ,  n  ;  j  =  1,  2,  ...,  v  (2.53) 


where  A^(ACL)  and  Aj  (E)  are  the  eigenvalues  of  ACL 
and  E,  respectively.  The  vector  differential  Equation 
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(2.49)  will  be  asymptot  ical  .ly  stable  if,  and  only  if,  the 
eigenvalues  of  Axc  have  negative  real  parts.  Therefore, 
we  may  state  the  following 

CONDITION  2.1  A  necessary  and  sufficient  condition  that 
Kxc  has  a  steady-state  value  Kxc  is  that 

Re  [Xi(Acl)  +  X j  (E)J  <  0; 

for  any  i  =  1,  2,  ...,  n  ;  j  =  1,  2,  v 

(2.54) 

i.e.,  that  the  sum  of  the  real  parts  of  any  eigenvalue  of 
the  closed-loop  system  matrix  A^l  and  any  eigenvalue  of 
the  set-point/command  matrix  E  is  negative. 

Condition  2.1  is  necessary  because  Axc  must  be  an 
asymptotically  stable  matrix  (Equation  2.49  must  have  an 
asymptotically  stable  solution  kxc(r))  to  ensure  that 
Kxc  exists.  Condition  2.1  is  a  sufficient  condition  be¬ 
cause,  if  Axc  is  an  asymptotically  stable  matrix,  then 
kxc( t)  is  asymptotically  stable  and  hence  Kxc  exists. 

Note  that  Condition  2.1  will  be  satisfied  for  the  con¬ 
stant  set-point  problem,  in  which  E  a  0  since  A^l  is  an 
asymptotically  stable  matrix  under  the  assumption  that  the 
pair  lA,  B]  is  completely  controllable,  and  Q  is  non-neg¬ 
ative  definite  so  that 

Re  [xi<ACIl>]  <  0;  for  a11  1  "  2' 


•  •  ; 


n 


(2.55) 
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In  addition.  Condition  2.1  will  be  satisfied  by  a  servo- 
command  dynamic  system  (2.1)  such  that  E  has  the  property 

Re [ \ j  ( E ) ) < 0  (2.56) 

Furthermore,  Condition  2.1  may  be  satisfied  by  certain  E 
matrices  having  eigenvalues  with  positive  real  parts  if  it 
is  known  that  Acl  has  a  certain  prescribed  degree  of 
asymptotic  stability  such  as 

*•  [V*CL>P  ctCL;  °CL  >  ®  (2‘57> 

where  ct^l  is  sufficiently  large.  In  that  case  Condition 
2.1  would  be  satisfied  for 

Re  [Aj<E)]  <  oCL;  0CL  >  0  (2.58) 

If  Condition  2.1  is  satisfied,  then  a  steady-state  value 
Kxc  will  exist,  such  that 

lin.  KXC(I)  -  Kxc  (2.59) 

T-M» 

Moreover,  when  the  constant  matrix  Kxc  is  substituted  in 
Equation  (2.31),  the  algebraic  equation 


40 


ACLTKxc 


K  E  = 
xc 


T 

C  QG 


(2.60) 


is  obtained,  where  Acl,  is  defined  by  Equation  (2.47)  and 
now  depends  on  the  constant  limit  Kx .  In  a  manner  similar 
to  that  used  in  the  analysis  of  the  differential  Equation 
(2.48),  Equation  (2.60)  may  be  written  as  the  equivalent 
vector  algebraic  equation  (20;  pp.231] 


xc  xc 


=  c 


xc 


(2.61) 


where  Axc  is  defined  in  Equation  (2.50),  the  vector  cxc 
was  defined  following  Equation  (2.49)  and  kxc  is  the  con¬ 
stant  (nvby  1)  vector  whose  elements  are  the  elements  of 
the  matrix  Kxc.  Since  the  eigenvalues  of  Axc  are 
Ai(ACl)  +  A j ( E ) ,  the  algebraic  equation  (2.61)  has  a 
unique  solution  if,  and  only  if  [20;  pp.  231], 


Ai(ACL)  +  A  j  (E)  ft  0; 

for  any  i  a  1,  2,...,  n  ;  j  *  1,  2,  ...,v 


(2.62) 


Moreover,  since  Equation  (2.61)  is  equivalent  to  Equation 
(2.60),  we  can  state  the  following; 

COROLLARY  2.1  A  necessary  and  sufficient  condition  that 
the  linear  matric  algebraic  Equation  (2.61)  has  a  unique 
solution  Kxc,  for  any  CTQG,  is  that 
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Xi  (Acl)  +  xj(E)  *  0  ' 

for  any  i  =  1,  2,  . ..,  n  ;  j  «*  1,  2,  .  ..,  v  (2.63) 


which  is  automatically  satisfied  if  Condition  2.1  is  met. 

The  necessary  part  of  Corollary  2.1  follows  since  the 
eigenvalues  of  Axc  must  be  non-zero  for  the  existence  of  a 
unique  solution  kxc  in  Equation  (2.61)  and  hence,  for  the 
existence  of  matrix  Kxc.  The  sufficient  part  of  Corollary 
2.1  follows  because,  if  the  eigenvalues  of  Axc  are  non¬ 
zero,  it  is  guaranteed  that  a  unique  solution  kxc  exists 
and  hence  that  a  unique  solution  Kxc  exists. 

A  parallel  approach  is  used  in  the  following  sections  to 
determine  the  existence  conditions  for  steady-state  gains 
Kxz,  Kc,  Kcz  and  Kz .  In  each  case,  a  linear  matric 
equation  is  analyzed  by  examining  an  equivalent  linear 
vector-matr ic  equation. 

2. 6. 2. 3  Existence  of  a  Steady-State  Solution 
Kxz.  The  conditions  for  the  existence  of  a  steady-state 
matrix 


*  lim  Kx2(t) 

X  “►  00 


(2.64) 


may  be  determined  by  an  approach  like  that  of  section 
2. 6. 2. 2.  The  differential  equation  (2.32)  involving 


Kxz(x )  may  be  written  {i£  Kx  exists  as  )  as  follows: 


KX2(T)  ‘  ACL  KX2|T>  *  KX2(T)D  +  KXFH  KXZ<0)  *  0  (2-65) 


Equation  (2.65)  may  be  expressed  by  the  equivalent  vector 
differential  equation 


kX2(T> 


A  k  (t) 
xz  xz 


+  c 


xz 


k  (0)  = 
xz 


(2.66) 


where  kxz  is  an  (np  by  1)  vector  whose  elements  are  the 
elements  of  the  matrix  Kx2,  and  cxz  is  an  (np  by  1) 
vector  whose  elements  are  the  elements  of  KXFH.  Axz  is 
the  (npby  np)  square  matrix  defined  by  the  Kronecker  sum 


A 


xz 


flCLXV  InXDT 


(2.67) 


Since  and  D  have  the  same  eigenvalues,  the  eigen¬ 
values  of  Axz  are 

A  ^  (  A  j  (D)  /  i  *  1,  2,  «  . «  ,  n  y  j  ■  1,  2,  ...,  p  (  2  •  6  8  ) 

where  A^(Acl)  are  the  eigenvalues  of  the  closed-loop 
system  (which  have  negative  real  parts  if  the  pair  [A,  B]  is 
completely  controllable  and  Q  is  non-negative  definite),  and 
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\j(D)  are  the  eigenvalues  of  the  system  matrix  of  the  dis¬ 
turbance  process,  Equation  (2.4).  The  vector  differential 
Equation  (2.66)  will  be  asymptotically  stable  if,  and  only 
if,  the  eigenvalues  of  Axz  have  negative  real  parts.  We 
therefore  have 

CONDITION  2.2  A  necessary  and  sufficient  condition  that 
Kxz  has  a  steady-state  value  is  that 


for  any  i  *  1,  2,  ...,  n  ;  j  =  1,  2,  ...,  p 

i.e.,  that  the  sum  of  the  real  parts  of  any  eigenvalue  of 
the  closed-loop  system  matrix  Acl  and  any  eigenvalue  of 
the  disturbance  process  system  matrix  D  is  negative. 

Since  Aql  is  asymptotically  stable,  Condition  2.2  will 
be  satisfied  by  disturbance  models  such  that 


Re  [Xj  (D)J  <  0 


(2.70) 


and,  in  the  special  case  where  it  is  known  that  A^l  pos¬ 
sesses  a  certain  prescribed  degree  of  asymptotic  stability 
such  that  Equation  (2.57)  holds,  then  Condition  2.2  will  be 
satisfied  by 


Re  [»j(D)]  <  oCL  ;  aCL  „  0 


(2.71) 
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If  Condition  2.2  is  satisfied,  then  a  steady-state  solu¬ 
tion  Kxz  will  exist,  and  when  this  is  substituted  in  Equa¬ 
tion  (2.32),  the  following  matric  algebraic  equation  is  ob¬ 
tained: 


aclTr«  +  S*ZD  ~gx™ 


(2.72) 


An  equivalent  vector  algebraic  equation  may  be  written  as 


A  k  =-c„„ 
xz  xz  xz 


(2.73) 


where  Ax2  is  defined  in  Equation  (2.67),  cxz  was  defined 
following  Equation  (2.66),  and  kxz  is  the  constant  (no  by 
1)  vector  where  elements  are  the  elements  of  the  matrix 
Kxz.  Since  the  eigenvalues  of  Axz  are  \  i(Acl)  +  Xj(D), 
the  algebraic  Equation  (2.73)  has  a  unique  solution 
if,  and  only  if,  [20;  pp.  231], 

Ai(ACL)  ♦  Xj(D,  X  0,  {2.74) 

for  any  i  *  i ,  2,  ...»  n  ?  j  *  1 ,  2,  ...,  v 

Moreover,  since  Equation  (2.73)  is  equivalent  to  Equation 
(2.72),  we  can  state  the 

COROLLARY  2.2  A  necessary  and  sufficient  condition  that 


the  linear  matric  algebraic  Equation  (2.72)  has  a  unique 
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solution  Kxz,  for  any  matrix  -KXFH,  is  that 
Xi(ACL)  +  Xj(D)  ft  0; 

for  any  i  =  1 ,  2,  . . . ,  n  ;  j  =  1,  2,  ...»  p 

which  is  automatically  satisfied  if  Condition  2.1  is  met. 

2 . 6 . 2 . 4  Existence  of  a  Steady-State  Solution  Kr . 
If,  as  t-*°°  ,  a  steady-state  matrix  Kxc  exists,  then 
Equation  (2.24)  leads  to  the  "backward-time"  equation 

K  (t)  *  ETK(t)  +  K  (  r )  E  -  K  TBP"1BTK  +  GTQG; 
c  c  c  xc  xc  (2.76) 

K  (0)  =  GTSG 
c 

Equation  (2.76)  is  stable  if,  and  only  if,  the  eigenvalues 
of  E  have  negative  real  parts,  which  leads  to 

CONDITION  2.3  A  necessary  and  sufficient  condition  that 
~RC  exists  is  that  (20;  pg .  231] 

Re(X  i(E)  +  X  .(E)]  <  0; 

for  any  i  *  1,  2,  ...,  v  ;  j  =  1,  2,  ...,v  ;  (2.77) 

(including  i  =  j) 

i.e.,  that  the  real  part  of  every  eigenvalue  of  E  be  nega¬ 
tive. 

This  is  a  stronger  condition  than  the  condition  for  the 
existence  of  Kxc .  Note  that  Kc  will  not  exist  for  the 
set-point  regulator  case,  since  for  that  problem,  the  set- 
point  "command  generator"  model  (Equation  2.7)  has  E  =  0, 
and  therefore  is  not  asymptotically  stable.  However,  Kc 
will  exist  for  such  servo-command  systems  as  may  be  modeled 
by  an  asymptotically  stable  linear  system  matrix  E. 


i 
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In  those  cases  where  Condition  2.3  is  satisfied,  the 
limit  Kc  may  be  substituted  in  Equation  (2.76),  resulting 
in  the  matric  algebraic  equation 


ETKc  +  KCE  =  KXCBR~  1B^KXC  -  GTQG  (2.78) 

which  has  a  unique  solution  Kc  if,  and  only  if,  it 
satisfies 

COROLLARY  2.3  A  necessary  and  sufficient  condition  that 
the  linear  matrix  algebraic  Equation  (2.78)  has  a  unique 
solution  Kc,  for  any  matrix  KXCBR-^BTKXC  “GtQG, 
is  that  Kxc  exist  and  that  [20;  pg.  231] 

Xi(E)  +  Xj (E)  ?  0; 

for  any  i  -  1,  2,  ...,v  ;  j  *  1,  2,  ...,v  ;  (2.79) 

(including  i  *  j) 

This  will  automatically  be  satisfied  if  Condition  2.3  is 
met. 

2. 6. 2. 5  Existence  of  a  Steady-State  Solution 
Kcz.  If,  as  T-f«,  Kxc  and  Kxz  exist,  then  Equation 
(2.25)  leads  to  the  "backward-time"  differential  equation 

Koz(T)  -  etkc2<t>  +  KC2(T)D  -  kxot(br'1btkxz  -  PH)(2.80) 

kC2(0)  .  o 
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The  stability  of  Equation  (2.80)  is  determined  by  X^E)  + 

X j ( D )  as  follows: 

CONDITION  2.4  A  necessary  and  sufficient  condition  that 
a  steady-state  solution  Kcz  exist  is  that  Kxc  and  Kxz 
exist  and 

Re [x  i (E)  +  X.(D)]  <0; 

for  any  i  =  1 ,  2,  . . .  ,  v  ;  j  =>  1 ,  2,  ...,p  .  1  ~  ^ 1 ' 

If  Kcz  exists,  then,  when  it  is  substituted  in  Equa¬ 
tion  (2.80),  the  result  is  the  matric  algebraic  equation 

T-  -  —  m  ,  T_  (2.82) 

E \z  *  KCZD  =  Kj(BR  Vk^,  -  PH)  , 

which  has  a  unique  solution  K  if,  and  only  if,  it 
satisfies 

COROLLARY  2.4  A  necessary  and  sufficient  condition  that 
the  linear  matric  algebraic  Equation  (2.82)  has  a  unique 

solution  K  ,  for  any  matrix  K  T(BR_1BTK  -FH) , 
cz  xc  xz 

is  that  K  and  K  exist  and 
XC  xz 

(E)  +  X.(D)  0; 

*  •  ■>  (2.83) 

for  any  i  =  1,  2,  ...,v  ;  3  =  1,  2,  ...,p 


which  will  be  automatically  satisfied  in  Condition  2.4  is 
met . 

2 . 6 . 2 . 6  Existence  of  a  Steady-State  Solution  K, . 
If  Kxz  exists  as  t-*-®,  then  Equation  (2.26)  leads  to 
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Kz(t) 

K,(0) 


DTKz(t)  +  Kz(x)D  -  KX2BR_1BTKxz+  [(rH)TKX2  +  KxzTFh]; 
0 

(2.84) 


which  is  asymptotically  stable  if,  and  only  if,  it  satisfies 
CONDITION  2,5  A  necessary  and  sufficient  condition  that 
a  steady-state  solution  Kz  exist  is  that  Kxz  exist  and 


Re  [xi(D)  +  Xj(D)]  <0; 

for  any  i  =  1 ,  2,  ...,p  ;  j  =  1 ,  2,  ...,p  ; 
(including  i  =  j) 

(2.85) 

i.e.,  that  every  eigenvalue  of  D  have  a  negative  real  part. 

Note  that  this  is  a  more  restrictive  condition  (on  the 

eigenvalues  of  D)  than  Condition  2.2. 

If  K  exists,  then  the  following  matric  algebraic 
xz 

equation  results  from  Equation  (2.84) 


+  *ZD  =  KxzT  BR-1BTKxz  -  [(FH)TKX  +  kJfh]  (2.86) 


which  has  a  unique  solution  Kz  if,  and  only  if,  it 
satisfies 

COROLLARY  2.5  A  necessary  and  sufficient  condition  that 
the  linear  matric  algebraic  Equation  (2.86)  has  a  unique 
solution  Kz,  for  any  matrix  RX2TBR_1B’rKxz 
-l(FH)TRxz  +  RxztFH]  is  that 
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Xi(D)  +  \.(D)  f  0; 

for  any  i  =  1,  1,  .  ,.,p  ;  j  *  1,  2,  .  ..,p  ;  (-.87) 

(including  i  =  j) 

which  is  automatically  satisfied  if  Condition  2.5  is  met. 

2.6.3  The  Steady-State  Control  Law.  If  the  conditions 
for  existence  of  Kx,  Kxc  and  Kxz  are  satisfied,  then 
the  steady-state  control  for  the  set-point/servo-tracking 
disturbance  utilizing  problem  exists  and  can  be  expressed  as 

u°  =  -R-1BT  f  K  x  +  K  c  +  K  z  1.  (2.88) 

Lx  xc  xz  J 

Furthermore,  the  steady-state  gains  Kx,  Kxc  and  Kxz 
are  found  as  the  unique  solutions  of  the  matric  algebraic 
Equations  (2.37),  (2.60)  and  (2.72),  respectively. 

The  performance  index  for  the  steady  state  set-point/ 
servo-tracking  problem  is 

j  =  J}XT(0C)  Sx(°°)  +  h  J*£xT(t)Qx(t)  +  uT(t)Ru(t)J  dt.(2,89) 

A  finite  value  of  J  in  the  infinite-time  problem  re¬ 
quires  that  the  set-point/servo-command  vector  c(t)  *  0  as 
t-*-«  .  This  can  be  seen  by  considering,  for  example,  the 

problem  of  regulating  the  plant  state  x  to  a  non-zero  set- 
point  xSp,  where  xSp  is  not  a  natural  equilibrium  point. 
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Maintaining  x  at  xsp,  as  t-*-00,  requires  a  constant  value  of 
control  u  in  this  case,  causing  the  integral  term  in  J  (an 
integral  over  an  infinite  time  interval)  to  be  infinite  in 
value.  This  property  may  be  summarized  by  stating  that  the 
performance  index  J  Equation  (2.89)  for  the  steady-state 
set-point/servo-tracking  disturbance-utilizing  problem  will 
be  infinite  if  the  system  matrix  E  of  the  set-point/servo- 
command  model  does  not  have  eigenvalues  with  negative  real 
parts. 

Similarly,  a  finite  value  of  J  in  the  infinite-time 
disturbance-utilizing  problem  requires  that  the  disturbance 
state  vector  z(t)  +0  as  t-*’00.  For  example,  a  constant  dis¬ 
turbance  in  the  steady-state  disturbance-utilization  problem 
leads  to  a  constant  control  u(t)  as  t-*-00,  which  in  turn  leads 
to  an  infinite  value  of  J.  Thus,  we  may  summarize  this 
property  by  stating  that  the  performance  index  J  (Equation 
2.89)  for  the  steady-state  set-point/servo-tracking 
disturbance-utilizing  problem  will  be  infinite  if  the  system 
matrix  D  of  the  disturbance  model  does  not  have  eigenvalues 
with  negative  real  parts. 

If  the  steady-state  problem  leads  to  an  infinite  value 
of  J ,  then  Equation  (2.88)  is  no  longer  a  rigorous  expres¬ 
sion  for  the  optimal  control,  but  may  serve  as  a  reasonable 


approximation  for  engineering  purposes.  Anderson  ani  Moore 

[17;  pg .  265]  state  that,  in  this  case. 

The  only  general  optimal  control  interpretation  of 
these  results  is  that  they  are  the  limiting  results 
of  the  finite-time  optimal  servo  problem  case.  That 
is,  they  have  properties  very  close  to  the  optimal 
systems  designed  for  a  large  terminal  time  T. 


2-6.4  Some  Methods  for  Determining  the  Steady-State 
Equilibrium  Values 


2. 6. 4.1  Explicit  Solution  for  Kv .  The  solution 
of  the  algebraic  Riccati  equation 


-1  T-  T  - 
(A  -  BR  B  K  )  K  + 
x  x 


K  A  +  C  QC  =  0 
x 


(2.90) 


may  be  found  in  explicit  form  as  follows  [9;  pg .  121], 
Consider  the  matrix 


-1  T 

-A 

BR  B 

ctqc 

at 

(2.91) 


Let  T  be  any  matrix  which  transforms  M  into  its  Jordan  form 
L,  so  that 


¥ 
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L  = 


MT 


(2.92) 


Then,  using  the  partitions  o£  L  and  T,  write 


r 

-A 

br_1bt 

“ 

T1 

- 

T2 

T1 

T2 

[4 

L2 

T 

C  QC 

at 

T3 

T4 

T3 

T4 

0 

L4 

Then,  provided  T^  is  nonsingular,  the  matrix 

K  =  T,T “1  (2.94) 

x  3  1 

is  a  solution  of  Equation  (2.90). 

Other  methods  of  explicit  solution  for  Kx  may  be  found 
in  [9]  and  [  17]  . 

2. 6. 4. 2  Explicit  Solutions  of  thf  Linear  Matric 
Algebraic  Equations.  The  linear  matrix  algebraic  equations 
for  Kxc,  Kxz,  Kc,  Kcz,  and  Kz  may  each  be  express¬ 
ed  in  the  general  form 


NK  +  KP  =  CK 


(2.95) 


The  solution  K,  if  it  exists,  is  unique  and  is  expressed  by 
(l 201;  pg.  175,  Theorem  6) 


K  =  -  /  eNt  CK  eFt  dt  . 

G 

This  is  seen  by  considering  the  equation 


(2.96) 


Z  *  N2  +  ZP  ,  Z  (0)  =  C. 


(2.97) 


Which  may  be  integrated  between  t  =  o  and  t  =*  assuming 
that  Lim  Z(t)  =  o,  the  result  is 


-C„  =  N(/  Zds )  +  (  f  Zds)  P 


(2.98) 


and  it  is  seen  that 


-/  Zds  -  -/  eNt  CK  ept  dt 


(2.99) 


satisfies  Equation  (2.95). 


Special  Cases 


Under  special  conditions  such  as  E  =  0  or  D  5  0 ,  simpler 
expressions  may  be  obtained.  For  example,  if  E  =  0  the 
equation  for  Kxc  (Equation  (2.60))  becomes 


ACLT  KXC  =  C  °G 


(2.100) 


and  if  (Aclt)-1-  exists,  then 


Kxc  =  (AclT)-1CTQG  =  pA  -  BR~1BTKx)TJ  CTQG  (2.101) 

which  can  be  solved  by  direct  matrix  operations.  As  a 
second  example,  if  D  =  0,  the  equation  for  Kxz  becomes 

aclt  hi -  -vh  (2-1021 

and  if  (Aclt)-1  exists,  then 

Kxz  =  -  [(A  -  BR‘1BTKx)T]‘1KxFH  (2.103) 

which,  again,  can  be  solved  by  direct  matrix  operations. 

2. 6. 4. 3  Computational  Methods.  One  way  to  com¬ 
pute  the  steady-state  solutions  of  the  matric  Riccati  and 
the  linear  matric  equations  is  to  use  a  digital  computer  to 
integrate  the  backward-time  equations  until  near-constant 
values  are  obtained.  This  approach  has  been  successfully 
used  with  second-  and  fourth-order  Runge-Kutta  integration 
algorithms . 


L 


Other  approaches  are  available  for  solving  the 
algebraic  matric  equations,  such  as  the  singular  perturba¬ 
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tion  method  {[17],  Chapter  15),  which  can  lead  to  con¬ 
siderable  savings  in  computer  time  in  obtaining  approximate 
solutions  of  matric  Riccati  equations. 


2 .7  The  Concepts  of  Burden,  Assistance  and  Utility  in 
Disturbance-Utilization  Control  Theory 

The  solution  Equation  (2.18)  of  the  Hamilton-Jacobi- 

Bellman  equation  involves  the  partitioned  matrix  P(t).  The 

partitions  of  P(t)  may  be  substituted  in  Equation  (2.18)  to 

obtain  the  expanded  expression 


V(x,c,z,t)  =  >5  (xTK  x  +  cTK  c  +  2xTK  c) 

X  c  xc 

+  (xX2  +  c\z>  2  + 


(2.104) 


The  solution  Equation  (2.104)  is  the  value  J°  of  the 
performance  index  J  obtained  under  optimal  control  u  =  u° 
at  the  general  initial  conditions  (x,  c,  z,  t).  The  last 
term  in  Equation  (2.104)  is  due  to  disturbances  alone,  and 
is  equal  to,  or  greater  than,  zero.  Since  it  does  nothing 
but  increase  the  minimum  value  of  J,  Johnson  has  defined  it 
as  the  "burden"  dff  [7] : 


i  4  ^  zTK_z  (2.105) 

Cj 

The  term  (xTK  +  cTK  )z  in  Equation  (2.104)  is 
xz  cz 

produced  by  interactions  between  the  plant  state  x  and  the 


disturbance  state  z,  and  between  the  set-point  state  c  and 
the  disturbance  state  z.  This  term  involves  bilinear  forms 
which  may  be  negative,  zero  or  positive  at  any  time  t.  When 
this  term  becomes  negative,  it  acts  to  further  reduce  the 
minimum  value  J°  (x,  c,  z,  t)  of  J  in  Equation  (2.104); 
that  is,  negative  values  of  this  term  actually  provide 
assistance  toward  the  objective  of  obtaining  a  minimum  value 
of  J.  Therefore,  Johnson  has  called  the  negative  of  this 
term  [7]  the  "assistance"  : 


*  ’  +  'Xz>Z  ' 


x(tQ)  =  x;  c(tQ)  =  c;  z(tQ)  =  z 


(2.106) 


The  sign  of  the  assistance  in  Equation  (2.106)  may  itself  be 
negative,  in  which  case  it  has  the  effect  of  an  additional 
burden. 

The  first  term  in  Equation  (2.104)  does  not  involve  the 
disturbance  state  z  at  all,  and  is,  in  fact,  the  minimum 
value  of  J  that  would  be  obtained  when  no  disturbance  is 
present.  Therefore,  any  constructive  action  by  the  dis¬ 
turbance  will  be  reflected  in  the  difference  between  the  V 
expression  when  the  disturbance  is  present  and  that  same  V 
when  the  disturbance  is  absent.  Johnson  has  defined  this 
latter  difference  as  "utility"  #[7]: 


-WAV 


w(  t)  =0 


v(t)  jt  0 


(2.107) 


Thus,  utility  can  be  written  as 
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V/  =  -UTKxz  +  cTKC2U  -  >jzTK2z  (2.108) 

or,  symbolically, 

(2.109) 

Positive  utility  results  when  the  assistance  is  greater 
than  the  burden  Whether  or  not  positive  utility  is 
achieved  at  any  time  t  during  the  control  interval  ttQ,  T] 
depends  on  two  general  characteristics  of  a  particular 
problem: 

(1)  the  magnitudes  and  signs  of  the  elements  in  the 
gain  matrices  and 

(2)  the  instantaneous  location  of  the  (x,  c,  z)  vector 
in  relation  to  those  regions  of  positive  and  negative  util¬ 
ity  as  determined  by  (2.108). 

2.8  Utility  Domains  in  Extended  State  Space 

The  topological  nature  of  the  domains  in  (x,  c,  z)  - 
space  in  which  positive  utility  is  achieved  can  be  de¬ 
termined  by  examining  the  equations  of  the  boundaries  of 
those  domains.  Since  the  function  (2.108)  is  continuous 
those  boundaries  are  defined  by  collections  of  points  in  the 
(x,  c,  z)  space  where  utility  is  zero.  Such  points  separate 
domains  of  positive  and  negative  utility,  in  general,  and 
are  defined  by 


y/  a 


ft*  /m 

<*  Kx*  +  0  K«)z  -  ^  v 


0  (2.110) 
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provided  *xz  has  maximal  rank  (which  in  this  case  is  0). 
If  o  *  n,  expression  Equation  (2.113b)  reduces  to 
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*T--^T  k2  IXJ'1  •• 


(2.114) 


n 


ft] 

ter  [y 1 


(2)  If  p>  (n  +  v),  the  maximal  rank  of[ 
is  n  +  v ,  and  therefore,  in  this  case 
does  not  exist,  so  an  explicit  solution  for  xT  is  not 
available.  However,  Equation  (2.111)  is  satisfied  by  z  *  0 
and  by 

_T 


[*TI=T]  fe]  ^ 


p  >  (n+v) 


(2.115) 


provided  Kz**l  exists. 

It  follows  from  Equations  (2.112)  and  (2.115)  that,  in 
the  general  case,  the  domains  of  positive  utility  are 
wedges,  lying  between  linear  subspaces  in  (x,  c,  z)  space. 

In  the  special  case  n  =  v  »  o  *  1,  the  positive  utility 
domain,  as  shown  in  Figure  2.1,  lies  between  the  plane  z  =  0 
and  the  intersecting  plane  defined  by  Equation  (2.112). 

Zero  utility,  for  n  *  v  =*  P  »  1,  corresponds  to  the  points 
satisfying 


z  -  0 


(2.116) 


z 


-2x 


-2c 


(2.117) 
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Figure  2-1.  Domains  of  utility  in  (x,  c,  z)  space  for  n  = 
v  =  p  =  1 


which  are  the  equations  of  the  planes  in  Figure  2.1.  The 
"tilted"  plane  Equation  (2.117)  intersects  the  c,  z  plane 
along  the  line 


z  = 


(2.118) 


and  intersects  the  x,  z  plane  along  the  line 


z 


(2.119) 


The  degree  of  "opening"  between  the  two  planes  of  Equations 
(2.116)  and  (2.117)  may  be  described  in  terms  of  two  angles, 

®xz  an<^  ®cz» 


defined  by 
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tan  9  xz 


dz 

dx 


c=0 


tan  6 


cz 


dz 

an 


x*0 


(2.120) 

(2.121) 


These  angles  are  shown  in  Figure  2.2. 


Figure  2-2.  Description  of  positive  utility  domain  size  by 

0XZ'  0  cz • 


Since  kxz  and  kz  are  never  negative,  0XZ  is  always 
non-positive.  On  the  other  hand,  kcz  typically  changes 
sign  during  the  control  interval  (t0,  T),  so  that  0CZ 
typically  changes  sign  during  this  interval. 

Description  of  the  positive  utility  regions  for  the 
general  case  appears  to  be  infeasible  due  to  the  associated 
geometrical  complexities.  In  general,  these  regions  of 
positive  utility  are  time-varying  regions,  since  the  gains 
Kxz,  Kcz  an<*  Kz  are  time-varying  solutions  of  matric 
differential  equations.  These  regions  may,  or  may  not  col¬ 
lapse  as  t  +  T,  depending  on  the  properties  of  the  set¬ 
point/servo-command  process  and  the  disturbance  process. 
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Some  dynamic  properties  of  the  utility  function  are 
discussed  in  the  next  section. 

2.9  Dynamic  Properties  of  the  Utility  Function 

It  follows  from  the  definition  of  the  utility  function: 

V/=  -(XTK  +  cTK  )  z  -  »S2TK  z  (2.122) 

xz  cz  z 


that,  if  the  disturbance  w(t)  is  asymptotically  stable, 
i.e.,  z(t)  +  0  as  t-*«,one  has  the  following 

PROPERTY  2 . 1  If  the  disturbance  w(t)  is  asymptotically 
stable,  such  that 

lim  z(t)  =0 

t  -  00  (  2.123  ) 


then  the  optimal  trajectory  x°(t)  has  the  property  that 
lim  W  (x(t),  c(t),  z(t),  t)  =  0? 

(2.124) 

CO 

for  all  bounded  c(t). 


The  known  terminal  conditions,  at  t  »  T,  on  the  matrices 
KXz  ( t ) »  and  Kz(t)  are 


Kxz1T>  -  C°3  nxo 

Kcz(T>  -  [°],xp 

VT>  *  [°U 


(2.125) 

(2.126) 
(2.127) 


which  leads  to 


PROPERTY  2.2 


V/(x(T),  C(T),  z  (T)  ,  T)  »  0  (2.128) 

Note  that  the  value  of  */  approaches  zero  continuously  as 
t  T,  since  Kxz(t),  Kcz(t)  and  Kz(t)  are  continuous 
functions,  each  of  which  approaches  zero  as  t  T.  The 
domain  of  positive  utility  for  a  specific  problem  may  be 
very  large  as  t  +  T,  but  at  the  exact  time  t  *  T,  no  points 
in  (x,  c,  z)  space  have  positive  utility. 

For  t  <  T,  the  value  of  4/  at  a  particular  time  depends 
on  where  the  composite  state  vector  lies  in  relation  to 
domains  of  positive  and  negative  utility.  The  conditions 
for  obtaining  positive  utility  are  stated  in 

PROPERTY  2.3  The  existence  of  a  positive  utility  domain 
at  a  particular  time  <  T  does  not  necessarily  imply 
that  the  value  y/(x(t].),  c(t]J,  z(ti),  t^)  of  the 
utility  function  is  positive  at  t  »  t^  :  realization  of  a 
positive  value  of  4/  also  requires  that  the  state  vector  at 
t  *  ti(x(ti),  c(ti),  z(ti>)  lie  in  the  domain  of 
positive  utility. 

It  is  interesting  to  inquire  if  the  evolution  of  y/ 

(x(t),  c(t),  z(t),  t)  can  be  described  by  a  differential 
equation  expression.  One  differential  equation  which  sat¬ 
isfies  can  be  derived  by  taking  the  time-derivative  of 
(Equation  2,110).  Part  of  the  result  may  be  recognized  as 
-  4t ,  resulting  in 


i 


dv/ 

dt 


+ 
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(2.129) 


where 


^  -  -*%Z  -  VH]Z  '  °T[XCZ  +  K1<CT(BR’1bTKX2  -  FH)]  2 


-  S  ZT  ?z  +  KxzTBR-1BTKxz  -  ^ 


(fh)TkxZ  -  KxzT™I  I  2 


1 


(2.130) 


The  value  of  d  ■fc/dt  as  t  T  is  found  by  substituting  (x(T), 
c(T),  z(T),  T)  =  0  and  (T)  in  Equation  (2.129),  resulting  in 

i 

PROPERTY  2.4 


if  -[« 


=  cx (T)  -  Gc (T) 


t=T 


J  T|SCFHj 


z(T) 


33  £y  (T)  -  Yc  (T)"j  T[sCFhJz(T)  (2.131) 

=  Je(T)J  T[sCFhJ  z  (T) 

where  y(T)  is  the  plant  output  Equation  (2.2)  at  t  =  T, 
yc(T)  is  the  output  Equation  (2.6)  of  the  servo-com¬ 
mand/set-point  process  at  t  *  T  and  e(T)  =  y(T)  -  yc(T)  is 
the  servo-command  (or  set-point)  error  at  t  =  T.  Note  that 
the  slope  of  ^  at  t  3  T  depends  directly  on  the  e(T);  if 
e(T)  is  small,  d-W/dt  will  be  near  zero  at  t  =  T, 

The  value  of  the  utility  function  in  the  steady-state 
(as  t-*«  )  may  be  found,  subject  to  the  conditions  of  the  fol¬ 
lowing 

PROPERTY  2.5  If  the  steady-state  gains  Kxz,  Kcz  and 
Kz  exist  as  the  backward  time  x-*»  ,  then 
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"5=  -UTKX2  +  cTKcz)z  -  >5ZTKzz;  for  T  ♦  »  .  (2.132) 

Thus,  the  value  of  utility  in  the  steady-state  problem  may 
be  positive,  negative,  or  zero,  depending  on  where  the 
trajectory  lies  in  (x,  c,  z)  space  relative  to  the  steady- 
state  domains  of  positive  and  negative  utility. 

It  is  also  possible  to  obtain  an  expression  for  the 
time-derivative  of  utility  for  the  steady-state  problem, 
subject  to  the  existence  of  certain  steady-state  gains. 
Equation  (2.129)  may  be  evaluated  under  steady-state 
conditions  described  in  the  following 

PROPERTY  2.6  If  the  steady-state  gains  Kx,  Kxz, 

Kcz  and  Kz  exist  as  backward  time  then 

if  -  *  IA  '  ^ViyXJz 

■  °T|?C2D  +  (2.133) 

-  >,2T[KzD  ♦  DTR2]z  ; 
for  t  -*•  00 

Thus,  the  time-derivative  of  utility  in  the  steady-state 
problem  may  be  positive,  zero,  or  negative,  depending  on  how 
the  matrices  in  Equation  (2.133)  are  structured  and  where 
the  trajectory  is  located  in  (x,  c,  z)  space. 

The  Concept  of  Maximum  Utility.  The  condition  for 
achieving  maximum  ?/  with  respect  to  the  disturbance  state  z 
may  be  determined  by  taking  the  gradient  of  (Equation 
2.110)  with  respect  to  z: 
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The  second  gradient  of  It  with  respect  to  z  is 


7 


z 


(2.134) 


which  is  negative-definite,  since  Kz  is  positive  definite. 
Therefore  we  may  state 

PROPERTY  2.7  The  critical  point  condition  for  a  maximum 
of  Qt  with  respect  to  z  is 


K 


xz 


X  + 


K  c  +  K  z=  0 
cz  z 


(2.135) 


Equation  (2.135)  describes  how  the  plant  state  x  should  be 
related  to  the  disturbance  state  z  and  the  set-point/servo- 
command  state  c  to  achieve  maximum  utility  Of  at  each  time  t 

e t ^ 1 • 

Additional  Properties  of  it.  Certain  additional 
properties  of  the  utility  function  it  seem  intuitively  to  be 
true.  For  example,  it  seems  that  tor  a  certain  specified 
terminal  state-weighting  matrix  S,  that  the  value  of  the 
utility  function  it  at  each  time  t  e[tQ,  T]  would  depend  on 
the  relationship  between  Q  and  R  in  the  performance  index  J, 
with  Q  =  0  leading  to  higher  values  of  a  . 

Some  numerical  examples  which  show  the  relations  between 
specified  control  objectives  (such  as  utilization  of  dis¬ 
turbances  and  set-point  regulation)  and  the  values  of  S,  Q 
and  R  are  presented  in  Chapter  III. 


CHAPTER  III 


SOME  SPECIAL  CASES  OF  DISTURBANCE-UTILIZING  CONTROL 
3 . 1  Summary  of  Chapter  III 

This  chapter  describes  the  application  of  disturbance¬ 
utilizing  control  techniques  to  several  specific  examples. 

In  particular,  the  following  are  considered:  (a)  A  scalar 
regulator  with  a  constant  disturbance,  in  which  both  zero 
set-point  and  non-zero  set-point  operation  are  considered: 

(b)  A  scalar  regulator  with  an  exponentially-decaying 
disturbance,  with  zero  set-point  and  non-zero  set-point. 

(c)  The  zero  set-point  regulation  of  a  second-order  plant 

with  a  vector  (two-dimensional)  disturbance.  Expressions 

are  obtained  for  the  limiting  values  (or  the  limiting  time- 

derivatives  when  no  limiting  value  exists)  of  the  gains  Kx, 

K  ,  K  ,  K  ,  K  and  K  for  cases  (a),  (b)  and  (c).  Cor- 
xc  xz  c  cz  z 

responding  expressions  for  systems  beyond  the  second  order 
present  formidable  computation  difficulties. 

These  examples  demonstrate  several  of  the  characteris¬ 
tic  properties  of  disturbance-utilizing  controllers  dis¬ 
cussed  in  Chapter  II,  including  positive-utility  conditions, 
the  existence  of  steady-state  values  of  system  gains,  the 
impact  of  disturbance  waveform  shape  on  the  effectiveness  of 
disturbance-utilizing  control,  and  the  potential  for 
significant  control  energy  savings. 


i . 2  Scalar  Regulator  with  a  Piecewise-Constant  Scalar 
Disturbance . 

3.2.1  General  Results.  Consider  the  scalar  system* 

x=x+u+w(t)  (3.1) 

y  *  x  (3.2) 

where  w(t)  is  a  piecewise  constant  scalar  disturbance  which 
is  modeled  by  the  system 

w  ■  Hz  ■  z  (3.3) 

t  *  Dz  +  o(t)  -  o  (t)  (3.4) 

where  H  *  1,  D  ■  0,  and  o  (t)  is  a  sparse  sequence  of  com¬ 
pletely  unknown  impulses.  The  primary  control  objective  is 
set-point  regulation  to  a  specified  (given)  state  xsp.  The 
secondary  control  objective  is  to  accomplish  the  primary  ob¬ 
jective  while  efficiently  utilizing  any  disturbance  effects 
which  may  be  available.  The  two  objectives  can  be  achieved, 
using  linear-quadratic  theory,  by  minimization  of  the 
quadratic  performance  index 


*Scalar  systems  of  the  more  general  form  x*ax  +  u+  w,  a 
■  constant,  can  be  put  in  the  normalized  form.  Equation 
(3.1)  above  by  introducing  the  time-scaling  t  -►  x/  a;  a  -  a, 
and  setting  Of  ■  ji/a. 


(3.5) 


JQO> 


H  s  e.‘(T) 
sp 


*  esp(t) 


+  r  u'MtJDdt 


with  respect  to  u,  where  s  >  o,  q^o,  r>o  and  egp  * 

Xgp  “  X(  t)  . 

The  family  of  piecewise-constant  set  points  lxSp] 
are  modeled  by  the  fictitious  dynamical  system 

xan  -  G  c  -  c 
sp 

6  »  E  c  +  U  (t)  *  U  (t) 

where  G  «  1,  E  •  0,  c  is  the  set-point  "state"  and  u(t)  is  a 
sparse  unknown  sequence  of  impulses. 

This  problem  is  solved  by  applying  the  theory  discussed 
in  Sections  2.4  and  2.5  of  Chapter  II.  An  augmented  vector, 
(Equation  2.8),  with  elements  x,  c  and  z,  leads  to  an  aug¬ 
mented  system  (Equation  2.9)  and  a  performance  index 
(Equation  2.10)  which  is  equivalent  to  Equation  (3.5).  The 
minimization  of  the  performance  index  J  subject  to  the 
augmented  system  Equation  (2.9)  is  accomplished  by  the 
Hamilton- Jacob i  theory.  The  solution  of  the  Hamilton- 
Jacobi-Be liman  equation  is  expressed  as  the  symmetric 
non-negative  definite  quadratic  form 


(3.6) 

(3.7) 


kxcl?  kxx  -  11  1  k«(T>  -  0 


K-hlz  -  2k*z  -•  VT> 


(3.14) 


(3.15) 


The  six  scalar  equations  (3.10)  -  (3.15)  correspond  to  the 
general  matric  Equations  (2.21)  -  (2.26),  with  A*l,  B«l, 
R  ■  r,  C  »  1,  Q  «  q,  S  »  s,  E«0,  G»l,  F  *  1,  H  *  1  and 
D  -  0. 

The  optimal  control,  Equation  (2.17),  may  be  written  in 
terms  of  the  solution  V  of  the  Hamilton-Jacobi-Bellman  equa¬ 
tion.  Thus,  using  the  relation  v  *  P  x  in  Equation 
(2.17),  the  optimal  control  for  the  present  problem  may  be 
written  as 


u°  *  lkx*  +  kxcc  +  kxx2) 


(3.16) 


The  solutions  of  Equations  (3.10)  -  (3.15)  which  must  be 
determined  over  the  interval  t  <  t  <  T  are  obtained  by 
backward  -time  integration  of  Equations  (3.10)  -  (3.15) 
"starting"  with  the  known  end  conditions  at  t  *  T. 

The  backward- time  equations  associated  with  Equations 
(3.10)  -  (3.15)  are  obtained  by  the  substitution  t  *  T  -  t, 
where  t  >  0  is  "backward  time."  This  latter  substitution 
transforms  Equations  (3.10)  -  (3.15)  to  the  form  (note  that 
( )-  d  /dT  in  (3.17)  -  (3.22)): 


kx(T)  *  (  1  -  ?kx(T,)  kx(T)  +  kx(T)  +  q  ;  kx(0)  *  s  (3*17) 


kxc(T)  =  (  1  “  rkx(T))  kxc(T)  "  q  ;  kxc(0>  *  ■  s  (3*10) 


kxz(T) 


<  1  -  ?kx(T)>  kxz(Tl  +  kx<T>  '  kxz(0) 


=  0  (3.19) 


kc(T)  =  -  ?  kxc  (T)  +  q  ;  kc(0)  =  5 


(3.20) 


kcz(T)  *  kxc(T)(  1  ‘  F  kxz<T))  »  kcz(0)  s  0  (3‘21) 


kz(r)  - 


k2  (x)  + 


r  xz 


2kxz(T>  ;  kz(0)  *  0 


(3.22) 


The  required  solutions  of  Equations  (3.10)  -  (3.15)  are  now 
found  by  solving  Equations  (3.17)  -  (3.22)  over  the  positive 
interval  0  £  x  £  (T-t0)  using  the  "initial-condition  "data 
at  t  *  0. 

3. 2. 1.1  Consideration  of  Limiting  Values  as  T  •»  00 

It  is  readily  verified  that  (3.1)  is  completely  control¬ 
lable.  Therefore,  since  q  >,  0 ,  it  is  assured  [15]  that 
Equation  3.17  has  a  solution  kx(T)  which  asymptotically 
approaches  a  certain  positive  value  kx  as  x  -*■  00  .  That 

is,  the  limit 


i 
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lim  kx(x)  ■  k  ,  k  -  constant  >0, 
x  -*•  «  (3.23) 

will  exist,  where  kx  is  the  unique,  positive  definite 
solution  of  the  "steady-state  Riccati  equation" 


(1  -  j  kx)  kx  +  kx  +  q  -  0  *  (3.24) 

The  positive  solution  of  Equation  (3.24)  is  readily  found  to 
be 

kx  ■  r  (  1  +  Vq/r  +  1)  .  (3.25) 

For  the  special  case  where  q  -  0,  Equation  (3.25)  yields 


k  ■  2r  ,  q  »  0 


(3.26) 


The  result  of  Equation  (3.25),  may  be  verified  by  start 
ing  with  the  general  solution  of  the  Riccati  differential 
Equation  (3.17)  and  evaluating  kx(x)  as  x  -*■<*>,  The  gener¬ 
al  solution  of  Equation  (3.17)  is  given  by  (8;  pg.  777] 


B  +  1  +  <B  -  !)(■ 


§  -  1  -  6 


-)e 


-20x 


kx(T> 


f  -  1  +  B 


1  -(§ 


=  -  1  -  8 


(3.27) 


•)e 


-28x 


■w* — -  - 


1  +  8 


where  x 


*  T  -  tf  and  for  our  case,  6  *  Wq/r  +  1  >  0. 

Letting  t  -*•  ®  in  Equation  (3.27)  yields  the  limiting  solution 


lim  kx(T)  =  r  (  1  +  /q/r  +  1  ) 

X  00 


(3.28) 


which  is  identical  to  the  solution  Equation  (3.25)  of  the 
algebraic  Riccati  equation.  Note  that  Equation  (3.27)  has 
other  solutions  that  do  not  satisfy  Equation  (3.28). 

The  conditions  for  the  existence  of  steady-state  values 
of  kxc,  kxz,  kc,  kcz  and  kz  (Conditions  2.1  -  2.5 
in  Chapter  II)  may  now  be  applied  to  the  last  five 
equations,  (3.18)  -  (3.22). 

Condition  2.1  indicates  that  the  solution  kxc(x)  of 
Equation  (3.18)  asymptotically  approaches  a  unique  steady- 
state  value  kxc  if,  and  only  if. 


1  -  j  kx  <°  .  (3.29) 

However,  satisfaction  of  Equation  (3.29)  is  guaranteed  for 
this  example  because  substitution  of  Equation  (3.25)  into 
Equation  (3.29)  yields 


1  -  ~  kx  ■  -  /q/r  +  1  <  0  . 


(3.30) 


The  unique  solution  of  Equation  (3.18)  is  easily  determined 
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*xc(T) 


+  C  e 
xc 


(  1 


(3.31) 


where 


q 

C  =  -  s  -  - - - 

XC  (1  -  i  k  ) 

r  x 

Thus,  the  limiting  value  kxc  is  obtained  from  Equation 
(3.31)  as 


k 

xc 


lira  k 

”  ->-<13 


XC 


-v  3  .33) 


Expression  Equation  (3.25)  for  kx  may  be  substituted  into 
Equation  (3.33)  to  obtain 


k 

xc 


q 


— •  /  V- 

'l/  - 


For  the  special  case  of  q  =  0,  (3.34)  reduces  to 


(3.34) 


kxc  -  0  ;  q  =  0  .  (3.35) 

Application  of  Condition  2.2  of  Chapter  II  shows  that  a 
well-defined  steady-state  value  kxz  will  exist  for  t.nis 


L 


example  problem,  because  the  disturbance  model  has  D  =  0, 
and  kx  exists.  The  unique  solution  of  Equation  3.19  is 
found  to  be 
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where 


k  (t) 
xz 


+  C  e 


xz 


(3.36) 


y  7  1  •  * 

(1  “  r  kx  5  (3.37) 

Letting  x-*00  in  Equation  (3.36),  the  steady-state  value 
kx2  is  determined  to  be 

k,,_  =  lim  k  (t)  =  — -l1— ~^r  +  1)  •  (3.38) 

xz  t  -  «xz  /57F'  +■  I 

The  special  case  q  =  0  reduces  (3.38)  to 


kxz  =  2r  ;  q  =  0  .  (3.39) 

Condition  2.3  of  Chapter  II  indicates  that  existence  of  a 
steady-state  value  kc  of  kc(T)  requires  that  every 
eigenvalue  of  the  matrix  E  in  the  set-point  dynamic  model 
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Equation  (3.7)  have  a  negative  real  part.  This  condition  is 
not  satisfied  for  this  example  (see  Equation  (3.7)).  as  we 
have  E  3  0.  Thus,  for  this  example,  no  steady-state  value 
kc  of  k^(:)  exists,  in  general.  We  may,  however,  find 
the  limiting  steady-state  slope  k^  of  the  solution  kc(x) 
as  t  -  *  .  For  this  purpose,  the  steady-state  value  of 

<]{;'  :)  may  be  substituted  into  Equation  (3.20)  to  obtain 


kc  =  lira  k  (t) 

oo 


q  +  r 


(3.40) 


which  snows  that  in  backward-t ime  t  tne  waveform  of 
approacr.es  a  positive-siope  ramp  ‘  a  negative-slope  ramp  in 
forward  time).  Although  Equation  i3.20)  does  not  have  an 
asymptotically  stable  steady-state  solution  in  general,  the 
special  case  q  3  0  does  lead  to  the  condition  that  the  limi¬ 
ting  rate  Equation  (3.40)  is  zero.  The  corresponding  value 

of  1  Lm  .<<-  ( r )  in  that  case  must  be  determined  by  mtegra- 
T-*-« 

tion. 


The  solution  kcz( 
asymptotically  stable 
are  both  zero  in  this 
limiting  slope  kcz(t) 
values  of  kxc  and  kxz 


t)  of  Equation  (5.21)  nas  no 
steady-state  solution  because  E  and  D 
particular  example.  However,  the 
as  t~®  is  found  by  substituting  the 
into  Equation  (3.21)  to  obtain 


Jk 


■  It  III  HI  ll*l  ill 
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.  .  r  q 

k  =  lim  k  (x)  =  -  >  0. 

°  t  -  °°ci  q  +  r  (3.41) 

It  may  be  observed  from  Equation  (3.41)  that  the  special 
condition  q  =  0  yields  a  limiting  rate  which  is  zero.  The 
corresponding  value  lim  kc2(T)  must  be  determined  by 
integration. 

An  asymptotically  stable  limiting  value  k2  for  the 
solution  k2(t)  does  not  exist  for  Equation  (3.22)  because 
D  =  0  in  this  example.  As  before,  the  limiting  rate  k2(x) 
as  x  -*■  00  can  be  calculated  rather  easily.  Namely,  if  kxz 
is  substituted  into  Equation  (3.22)  one  obtains 


k 


z 


•  -r  (1  +>'q/r  +  1) 

lim  k  (t)  =  - 

t  -*■  00  q  +  r 


+  2  r  (1  +  /g/r  +  1) 
/q/r  +  1 


(3.42) 


As  before,  the  special  case  q  =  0  results  in  a  zero  value  of 
the  limiting  rate  Equation  (3.42);  however,  more  generally. 
Equation  (3.42)  describes  a  positive-slope  ramp  (a  negative- 
slope  ramp  in  forward  time)  which,  of  course,  is  unbounded 
as  x  ->  00  . 
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Table  3-1  summarizes  the  limiting  steady-state  gains  for 
this  example  with  piecew ise-constant  disturbances. 

Figure  3-1  summarizes  the  waveform  properties  of  the 
forward-time  gain  histories  in  this  example,  for  general 
non-negative  values  of  s,  q  and  r. 

Only  the  first  three  gains  kx(t),  kxc(t)  and 
kxz(t)  are  required  in  computing  the  optimal  control  u#(t) 
for  this  example  (see  Equation  (3.16));  however,  the  two 
"gains"  kcz(t)  and  kz(t),  along  with  kxz(t)  are  useful 
in  computing  the  utility  functions. 

The  utility  f unct  ion  ■&  f or  this  example  is  found  from 
Equation  (2-108)  to  be 


w  ■  -k  xz  -  k  cz  -  k  z~. 
xz  cz  z 


(3.43) 


The  positive-utility  domains  for  examples  of  this  type  were 
determined  in  Chapter  1 1  as  the  "opening"  between  two 
planes,  as  shown  in  Figure  2-1.  The  degree  of  "opening"  be¬ 
tween  the  planes  was  expressed  in  terms  of  two  angles,  de- 
f  ined  by 


'  -2 


tan  3  ■  -2 

cz 


3.44) 


(3.45) 


Figure  3-1.  Typical  forward-time  gain  histories  for  a 
scalar  set-point  regulator  with  a  constant 
disturbance  and  disturbance-utilizing 
control . 
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which  are  illustrated  in  Figure  2-2 .  In  general, 
non-negative  values  of  q  and  r  result  in  a  bounded 
steady-state  value  of  kx2  but  an  unbounded  value  of  k2 
as  t  -*■  00  (see  Figure  3-1);  hence,  in  the  steady- 
state; 

?  «  lim  0  (t)  *  0  ,  general  non-negative 

xz  t  °°x  values  of  r,  q  .  (3.46) 

An  interesting  special  case  for  this  example  occurs  for  the 
value  q  *  0,  causing  the  right  side  of  Equation  (3.42)  to 
then  be  zero,  and  giving  the  non-zero  steady-state  value  of 
Equation  (3.46)  as 

ff  -  lim  0  (x)  -  tan  ~1(-2)  *  -63.43°,  q  -  0. 

xz  T  -  «XZ  (3.47) 

Equation  (3.44)  is  indeterminant  at  t  ■  0  (i.e.,  at  the 
terminal  time  t  *  T);  however,  by  applying  L'Hospital's  rule 
to  the  ratio 


+  2  k 


xz 


(3.48) 


it  is  easily  determined  that 
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lim  /  d  k 


t+0  \  d  k 


(3.49) 


and  therefore,  if  s  >  0,  Equation  (3.44)  yields 


0  ■  lim  9  -  -90  ;  s  >0. 

xz  t-*-o  xz 


(3.50 


In  a  similar  manner,  Equation  (3.45)  yields,  in  general, 
the  indeterminant 


lim  tan  0„..  (t)  »  -2 
cz 


which,  by  application  of  L'Hospital's  rule  gives 


(3.51) 


9CZ  *  lim  9cz(T)  * 


l/q/r  +  1  J  [,/q/r  +  1  J 


(3.52) 


The  denominator  of  Equation  (3.52)  is  positive  for  all  posi¬ 
tive  r  and  q.  When  q  ■  0,  the  denominator  is  zero,  in  which 
case  Equation  (3.51)  yields  the  limiting  value  e cz  -  0. 
Therefore,  the  range  of  variations  of  9 cz  is,  in  general. 


-90  <  0C2  <  0. 


(3.53) 


J 


at  terminal  time  t  *  T) 


The  value  of  ecz  at  x  *  0  (i.e., 
is  found  by  applying  L'Hospital's  rule  to  obtain 


lim  tan  8  =  -2 

T*0  «  T'°\k2  )  T 


(3.54) 


which,  for  s  >  0,  leads  to  the  value 


9  ( t*T)  »  lim  8  ( t )  *  +90 

cz  T-*-0 


(3.55) 


It  is  interesting  to  note  that0C2(t)  may  change  sign  over 
the  interval  t  inlt0,T]. 

The  foregoing  properties  of  8xz(t)  and  9cz(t)  are 
summarized  in  Table  3-2,  for  several  combinations  of  q,  r 
and  t  .  Some  typical  domains  of  positive  utility  for  this 
example  are  shown  in  Figures  3-2  and  3-3,  for  the  case  of 
large  values  of  t (near  steady-state)  and  small  values  of 
t  (near  terminal-time),  respectively. 


3.2.2  Some  Specific  Numerical  Examples 

3. 2. 2.1  Zero  Set-Point  Regulator;  Scalar  Plant, 
Constant  Disturbance.  Computer  results  for  these  numerical 
examples  were  obtained  from  a  CDC-6600  program  using  Runge- 
Kutta  fourth-order  integration  with  a  computation  interval 
of  0.02  seconds  for  integrating  the  plant  equations  and  the 
gain  equations.  The  ideal  case  of  direct  on-line 
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Figure  3-2.  Typical  domains  of  positive  utility  in  x-z  and 
c-z  state  space  for  large  values  of  backward 
time  (t-*-®,  near  steady-state);  scalar  plant 
set-point  regulator,  constant  disturbance, 
q  >  0  and  r>  o. 


Figure  3-3.  Typical  domains  of  positive  utility  in  x-z  and 
c-z  state  space  for  small  values  of  backward 
time  (near  the  terminal  time);  scalar  plant, 
set-point  regulator,  constant  disturbance, 
q  >  0  and  r  >  0. 
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measurements  of  the  entire  plant  state  x  and  the  entire  dis¬ 
turbance  state  z  was  assumed  for  these  studies.  This  as¬ 
sumption  permitted  determination  of  the  performance  of  the 
disturbance-utilizing  controller  without  regard  to  the 
imperfections  introduced  by  the  state-reconstructors. 

Numerical  solutions  of  the  three  differential  equations 
((3-10),  (3-12)  and  (3-15))  are  presented  in  Figure  3-4  for 
the  case  s  »  1,  q  *  1,  r  *  1,  T  *  6.0.  These  specific  re¬ 
sults  may  be  compared  with  the  typical  histories  sketched  in 
Figure  3-1. 

3. 2. 2. 1.1  Negative  Disturbance,  Positive  x(o). 

Numerical  results  for  the  zero  set-point  regulator  with 
s  •  1,  q  ■  o,  r  »  1,  T  »  6.0,  w(t)  *  -16.1  and  x(o)  •  30.0 
are  shown  in  Figures  3-5  and  3-6 .  Although  the  structure  of 
this  particular  example  results  in  the  existence  of  steady- 
state  values  for  the  three  scalar  gains  kx,  kX2  and  kz 
when  q  »  o  (see  Figure  3-5)  this  outcome  is  not  typical  for 
the  general  case.  It  may  be  seen  that  the  x-z  state  trajec¬ 
tory  (Figure  3-6)  remains  inside  the  positive  utility  sector 
for  each  tin[t0,T]  and  thus  the  value  of  the  utility  func¬ 
tion  is  positive  for  the  whole  control  interval,  except  at  t 
=  T.  The  control  u8  and  state  x  for  the  corresponding 
linear-quadratic  (LQ)  controller  are  shown  as  dashed  curves 
in  Figure  3-6  for  comparison.  All  parameter  values  for  the 
LQ  controller  are  the  same  as  those  of  the  disturbance¬ 
utilizing  (DUC)  case,  except  that  the  LQ  example  does  not 
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utilize  or  otherwise  account  for  the  disturbance.  Thus, 

the  LQ  example  uses  the  conventional  L Q  control  u°LQ(t) 
h2 

*  -  H  kx(t),  where  kx(t)  is  precisely  the  same  time 
function  as  kx(t)  Figure  3-5.  The  bias  effects  of  the 
constant  disturbance  are  readily  seen  in  the  LQ  control  and 
state  histories  (Figure  3-6);  these  effects  do  not  appear  in 
the  disturbance/utilizing  controller,  however.  Table  3-3 
summarizes  the  terminal-time  performance  of  this  example  in 
terms  of  the  components  Jm,  Jq  and  Jr  of  the  per¬ 
formance  index  J,  the  terminal-state  regulation  error*,  the 
value  of  the  control  energy  EU  consumed  during  the  control 
interval  [0,  T]  and  the  "effectiveness"  parameters  iT, 
and  the  pertinent  parameter  definitions  are  as 

follows: 


'm 


H  s  e  (T) 


T 

Jq  -  Hid  x2  (t)  dt 


Jr  -  •*  '  rCu°(t)D2dt 


(3.56) 


(3.57) 


(3.58) 


EU  =  S  Qf  (u°(t) )2dt 


(3.59) 
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TABLE  3-3. 


COMPARISON  OF  PERFORMANCE  OF  DISTURBANCE¬ 
UTILIZING  CONTROLLER  AND  CONVENTIONAL  LQ 
CONTROLLER;  SCALAR  ZERO  SET-POINT  REGULATOR, 
WITH  CONSTANT  DISTURBANCE,  w(t)  *  -16.1, 
x=n  -  0.0,  s  -  1,  q  -  o,  r  -  1,  T  -  6.0. 


J 

J 

J 

m 

q 

r 

DUC 

0.0021 

0. 

192.4 

LQ 

313.6 

0. 

2155. 

J(T) 


x®=-x(T) 

sp 


■0.065  99.7  192.  91.1 


25.05 


2156. 


J(T,  .  Jm  +  J  +  Jr 


T  T 

Jjae2  (T)  +  ij  /  qe2  (t)  dt  +  *5  /  r  u°2  (t)  dt 


u  ^ DUC  r  (kxx  +  kxz 


“°ILQ  "  ~r  kxx 


T  /• 

SU  »  h  f  [«°(t>]  dt 
o 

4  JLQ  -  JDOC  x  1004 
T  JLQ 

*  £  lXSD  ”  I  TQ  ~|xg_  -  X(T)  |  DUC 

®M  9  — ®E - ±±y - EE - EHil-  X  100% 

I  xsp  “  x  (T)  |  lq 


A  FjULQ  ~  EUPUC 


x  100% 
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"Total  effectiveness"  &•?  is  defined  as 


JLQ  ~  JDUC 
JLQ 


x  100% 


(3.60) 


"Miss-distance  effectiveness"  4^  is  defined  as 


xsp  -  x(T)  |T.n-|xSD  -  x(T) 


LQ  sp 


DUC 


M 


Xgp  *  X  (T) | 


x  100% 


LQ 


(3.61) 


"Energy  effectiveness"  is  defined  as 


eulq  -  euduc 


x  100% 


EU 


LQ 


(3.62) 


Positive  values  of  *<]*,  ^  or  mean  that  the  distur¬ 
bance-utilizing  controller  has  achieved  a  lower  value  of  J, 
absolute  miss-distance  or  control  energy  consumption, 
respectively,  than  the  LQ  controller.  The  maximum  possible 
values  of  4^ ,  4^  or  ace,  of  course,  100%.*  Note, 
in  Table  3-3,  that  the  DAC  controller  obtains  very  large 
positive  values  of  4^,  and  The  disturbance 

utilizing  controller  for  this  example  uses  less  than  9 
percent  of  the  control  energy  required  by  the  conventional 
LQ  controller.  Moreover,  the  disturbance-utilizing 
controller  achieves  a  set-point  error  of  -0,065  feet  —  only 
0.3%  of  the  25.05  feet  set-point  error  of  the  LQ  controller. 


*Note,  for  example,  that  if  Jduc  is  i0%  of  <Jl.Q'  <*T 
90%;  if  Jduc  *s  ^o%  °f  Jlq»  **t  *  io^. 


3.2.2. 1.2  Positive  Disturbance,  Positive  x{ o).  The 
previous  case  involved  a  constant  negative  disturbance  which 
resulted  in  a  trajectory  lying  inside  the  positive-utility 
domain  in  the  x-z  plane.  We  now  consider  the  case  in  which 
the  sign  of  the  disturbance  is  reversed;  that  is,  where  w(t) 
has  a  constant  positive  value,  with  all  other  conditions 
remaining  exactly  the  same  as  in  the  previous  case.  The 
time  functions  kx(t),  kxz(t)  and  ^z(fc)  are  exactly  the 
same  as  for  the  previous  case  (see  Figure  3-5),  since  they 
do  not  depend  on  the  specific  waveform  of  the  disturbance. 
The  performance  for  this  case  is  summarized  in  Figure  3-7 
and  Table  3-4.  In  this  example,  the  initial  conditions 
(x(o),  z(o))  lie  in  the  negative-utility  domain  (in  the 
first  quadrant).  However,  the  disturbance-utilizing  control 
forces  the  x-z  state  trajectory  into  the  second  quadrant, 
where  positive  utility  is  available.  The  disturbance¬ 
utilizing  control  maneuvers  the  system  so  that  positive 
utility  is  "made  available"  for  this  case  during  the  time 
interval  following  1.8  seconds.  Figure  3-7  shows  how  the 
x-z  trajectory  "doubles  back"  on  itself  between  1  and  6 
seconds.  Although  the  state  is  driven  to  zero  at  t  ■  1,  the 
terminal-time  specification  is  not  satisfied  until  t  ■  6, 
when  the  problem  ends.  The  DUC  uses  the  "extra  time" 
between  1  and  6  seconds  to  place  the  trajectory  within  the 
>  o  sector  of  the  x-z  plane.  Note  the  bias  effect 
(Figure  3-7)  of  the  disturbance  on  the  L Q  control,  which 
results  in  a  large  positive  value  of  x(T). 


CONTROL 


XZ  TRAJECTORY 


t*l  and  6 
y — t»0. 5 


PLANT  STATE 


OPENING"  ANGLE 


B  (BURDEN)  / 

i — A  (ASSISTANCE)  1 

-90-1 

x 

/ 

i  UTILITY 

BURDEN,  ASSISTANCE 


Figure  3-7. 


Computed  performance  of  disturbance-utilizing 
scalar  regulator  with  zero  set-point,  constant 
disturbance,  s  *  1,  q  ■  o,  r  ■  i,  w(t)  *  +16.1 
x(o)  ■  30.0,  T  ■  6.0. 
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TABLE  3-4. 


COMPARISON  OF  PERFORMANCE  OF  DISTURBANCE¬ 
UTILIZING  CONTROLLER  AND  CONVENTIONAL  LQ 
CONTROLLER;  SCALAR  ZERO-SET-POINT  REGULATOR 
WITH  CONSTANT  DISTURBANCE,  W(t)  ■  +16.1, 

Xgp  -  0.,  x(o)  -  30.0,  a  -  1,  q  ■  o, 

*  1,  T  *  6.0. 


JQ 

JR 

J  <T) 

fT 

* 

*sp  "  X(T) 
(ft) 

% 

EU 

K 

0.023 

0. 

2100. 

2100. 

52.0 

-0.21 

99.2 

2100. 

48.2 

320.7 

0. 

4056. 

4377. 

X 

-25.33 

X 

4056. 

X 

J(T) 


J  +  J  +  J_ 
m  q  r 


>,»e2(T)  +1)  /  qe2(t)dt  +  >1  I  r  uo2(t)  dt 


u°  I DAC 


'  f  (kx*  +  kxz*> 


U<>ILQ  "  -  I  kxx 


EU  A  Ij  /  [»•(«]  2dt 


4  Jm  ~  V?  .  x  ioo« 

*T  JL0 


'«  ^  ^ 


«r 


E 


lx.„  -  »IT)Im  -lx.p  -  X(T) 


Puc  x  100% 


l*,p  -  x(«l 


LQ 


EULQ  2  EUPUC 


EU 


LQ 


x  100% 


This  may  be  compared  with  the  previous  case,  where  the  nega¬ 
tive  disturbance  caused  the  LQ  controller  to  have  a  large 
negative  x(T). 


The  terminal-time  performance  for  this  case  (Table  3-4) 
shows  that  the  effectiveness  parameters  4?,  and 
are  all  positive,  indicating  that  the  DUC  performs  better 
than  the  LQ  controller  on  the  basis  of  J(T),  miss-distance 
and  control  energy  consumption.  The  control  energy  require¬ 
ments  are  considerably  larger  for  both  the  LQ  and  the  DUC  in 
this  case,  because  the  amount  of  positive  utility  is  re¬ 
latively  small.  However,  the  disturbance-utilizing  control¬ 
ler  expends  only  51.8%  as  much  control  energy  as  the  LQ  con¬ 
troller.  Moreover,  the  DUC  accommodates  the  disturbance  to 
produce  a  set-point  error  of  -0.21  feet  versus  -25.33  feet 
for  the  LQ  controller  —  a  miss  distance  only  0.8%  as  large 
as  the  LQ  miss  distance. 

3. 2. 2. 1.3  Some  Effects  of  Varying  q/r.  The 
importance  of  the  ratio  q/r  has  been  seen  in  connection  with 
the  determination  of  the  time-varying  gains  for  the  distur¬ 
bance-utilizing  controller.  When  q  ■  o,  varying  r  has  very 
little  effect  on  control  energy  EU,  but  when  q  >  o,  the  q/r 
ratio  affects  not  only  EU,  but  also  Jq,  Jr  and  xSp  - 
x(T).  Table  3-5  compares  the  performance  for  three  differ¬ 
ent  ratios  of  q/r  in  the  disturbance-utilizing  example  under 
consideration.  Except  for  the  q  and  r  values,  the 
conditions  of  this  example  are  identical  with  those 


of  section  3. 2. 3. 1.1,  where  w(t)  =  -16.1.  When  g  is 
increased  from  q  3  o  to  q  =  1,  less  relative  weight  is 
placed  on  terminal  set-point  error  in  the  performance  index 
J,  with  the  result  that  the  terminal  miss-distance  increases 
to  3.31  feet.  Another  effect  is  seen  in  the  increased 
control  energy  EU  required  to  keep  the  squared  state  x2(t) 
closer  to  zero  during  the  control  interval  [o,T] .  When  the 
q/r  ratio  is  changed  to  1/10,  the  control  energy  requirement 
is  brought  back  down  to  a  value  only  slightly  larger  than 
for  the  case  of  q  =  o;  but  the  terminal  miss-distance  then 
increases  slightly  because  its  relative  weighting  has 
decreased  even  further.  This  example  illustrates  the 
various  cost  trade-offs  which  one  must  consider  when 
choosing  values  of  s,  q  and  r  in  disturbance-utilizing 
regulator  designs. 

3. 2. 2. 2  Non-Zero  Set-Point  Regulator;  Scalar 
Plant,  Constant  Disturbance.  When  the  scalar  system  of  the 
previous  examples  is  operated  as  a  non-zero  set-point  re¬ 
gulator,  with  a  constant  disturbance  w(t)  *  -16.1  and  a 
set-point  xSp  *  -10.,  the  results  of  Figures  3-8  and  3-9 
and  Table  3-6  are  obtained.  Note  that  the  kx(t),  kxz(t) 
and  kz(t)  time  functions  in  Figure  3-8  are  identical  with 
those  of  the  previous  examples  (see  Figure  3-5 ) .  In  ad¬ 
dition,  the  kxc(t),  kc(t)  and  kcz(t)  gains  are  re¬ 
levant  to  the  non-zero  set-point  case  considered  here. 
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TABLE  3-5.  THE  EFFECT  OF  VARYING  q/r  ON  THE  DISTURBANCE¬ 
UTILIZING  CONTROLLER;  SCALAR  ZERO  SET-POINT 
REGULATOR  WITH  CONSTANT  DISTURBANCE,  w(t)  « 
-16.1,  xsp  *  0.,  X ( o )  »  30.0,  T  -  6.0 


s 

q 

B 

Jq 

n 

J  (T) 

xsp  -  X(T) 

EU 

D 

D 

a 

0.0021 

192.4 

192.4 

-0.065 

192. 

D 

a 

a 

5.48 

359.8 

364.3 

729.6 

3.31 

364. 

n 

D 

10 

10.80 

727.7 

1970. 

2708. 

4.65 

197. 

J  (T)  =  J  +  J  +  J 
m  q  r 

■T  T 

=  (T)  +  *5  /  qe^(t)dt+J5  /  r  u°^(t)dt 

to  fco 

T  2 
h  f  [u°(t)]  dt 
o 


EU  ■ 


sec  *r 

Figure  3-8.  Numerical  gain  solutions  for  case  of:  scalar 
plant,  scalar  disturbance,  non-zero  set-point, 
constant  disturbance,  s  ■  1,  q  ■  o,  r  ■  1, 


Figure  3-9.  Computed  performance  of  disturbance-utilizing 
scalar  regulator  with  non-zero  set-point,  con 
stant  disturbance;  s  ■  1,  q  *  o,  r  *  1,  w(t) 
—16.1,  Xgn  *  —10.0,  x(o)  *  30.0,  T  *  6.0. 
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TABLE  3-6.  COMPARISON  OF  PERFORMANCE  OF  DISTURBANCE¬ 
UTILIZING  CONTROLLER  AND  CONVENTIONAL  LQ 
CONTROLLER;  SCALAR  REGULATOR  WITH  NON-ZERO 
SET-POINT  AND  CONSTANT  DISTURBANCE;  w(t)  = 
-16.1,  xsp  =  -10.0,  x(o)  =  30.0,  s  =  1, 
q  =  o,  r  =  1 ,  T  =  6.0 


J 

IT> 

J 

q 

J 

r 

J  <T) 

% 

xsp  -  x  (T) 

4 

EU 

e 

L. 

% 

-2 

0.2122x10 

0. 

193.1 

193.1 

92.2 

-0.065 

99.7 

193.1 

91  .  0 

313.6 

0. 

2155. 

2469. 

X 

25.05 

X 

2155. 

X 

J(T)  -  J.  +  Jq  ♦  Jr 

T  T 

*  %  se2  (T)  +  /  qe2(t)dt  +  h  f  r  uo2(t)dt 

to  to 


u 


DAC 


-  ?  (kXX  +  kXCC  +  kX2Z) 


LQ 


-  (k  x  +  k  c) 
r  xA  xc 


4  JLQ  ~  JDUC 
JLQ 


x  100% 


g  A  _ 3p  ~  x(T)  'LQ  xsp  ~  X(T)  DUC 
M  * 


x  100% 


'x  sp  ~  X  (T)  I  lq 


A  EULQ  ~  EUPUC 


EU 


LQ 


x  100% 
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Figure  3-9  shows  that  the  DUC  obtains  positive  utility  tor 
the  6  second  control  interval  (except  at  t  ’  T).  The  x-z 
trajectory  remains  in  the  positive  utility  domain  of  the  x-z 
plane  for  the  first  5.5  seconds  of  the  control  interval  as 
it  moves  through  the  fourth  quadrant  toward  the  set-point 
( xSp  *  -10).  The  c-z  "trajectory"  for  this  example  is  the 
point  (c  ■  -10,  z  3  -16.1).  This  point  "trajectory"  lies  in 
the  positive  utility  domain  of  the  c-z  plane  during  the  last 
0.9  seconds  of  the  control  interval.  This  may  be  verified 
by  noting  that  9CZ  is  greater  than  58.2  degrees  (tan--*- 
16.1/10.0)  for  the  last  0.9  seconds,  which  means  that  the 
c-z  point  "trajectory"  is  inside  the  positive  utility 
domain.  The  net  result  of  the  actions  of  the  set-point 
"command"  and  the  disturbance  is  that  positive  utility  is 
"made  available"  for  the  whole  control  interval.  The 
constant  disturbance  has  a  very  detrimental  effect  on  the  LQ 
control  and  state  histories  (Figure  3-9),  resulting  in  a 
large  set-point  error.  The  terminal-time  performance  for 
this  example  is  shown  in  Table  3-6.  Note  that  the  control 
energy  EU  required  by  the  DUC  in  this  example  is  only 
slightly  larger  than  that  required  by  the  zero  set-point 
regulator  (compare  with  Table  3-3 ) .  This  is  apparently  due 
ro  the  fact  (observed  above)  that  the  x-z  trajectory  and  the 
c-z  trajectory  are  complementary,  in  terms  of  the  respective 
time  intervals  during  which  they  lie  in  positive  utility 
domains.  The  effectiveness  parameters  £?,  and  £e, 
are  all  positive  and  quite  large,  reflecting  the  superior 
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performance  of  the  DUG  in  terms  or  performance  index  J, 
set-point  error  and  energy  consumption. 

3 . 3  Scalar  Regulator  with  an  Exponentially-Decaying 
Disturbance 

3.3.1  General  Results.  In  this  example  we  consider 
tne  scalar  system  of  Equations  (3.1)  and  (3.2),  where  the 
disturbance  w(t)  is  exponentially  decaying,  so  that 

wit)  =  C^e  ,  a>0  (3.63) 

w  =  Hz  ,  H  =  ill  (3.64) 

z  =  Dz  +  o(t),  D  =  -Cl  (3.65) 

where  <r  (t)  is  a  sparse  sequence  of  impulses.  The  dual 
control  objectives  of  set-point  regulation  and  efficient 
utilization  of  available  "disturbance  eneray"  are  to  be 
realized,  as  before,  by  minimizing  the  quadratic  performance 
index  J  (Equation  (3.5)).  The  s ?t-point  is  represented  as 
the  output  of  the  dynamic  system  Equations  (3.o)  and  (3.7), 
and  the  control  will  be  found  as  in  Equation  (3.16).  The 
set  of  unilaterally-coupled  differential  Equations  (2.21)  - 
(2.26)  for  this  example  turns  out  to  be 

k  =  (-1  +  i  k  )  k  -  k  -  q  ;  k  (T)  =  s  (3.66) 

X  k  X  X  X  X 
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kxc  -  ('X  +  ?  V  kxc  +  q  *  kxc  (T)  "  'S  (3-67) 


k  =  (-1  +ci+  -  k  )k  -  k  ;  k  (T)  =  0  (3.68) 

xz  r  x  xz  x  xz 


kc  =  F  kxc2  -  -•  ko  1T)  *  s 


(3.69) 


k  =  ak  +  (-1  +  -  k  )  k  ;  k  (T)  =  0  (3.70) 

cz  cz  r  xz  xc  cz 


k2  =  2akz  +  i  k2xz  -  2kxz  ;  k2  (T)  =  0  (3.71) 

Equations  (3.66)  -  (3.71)  correspond  to  the  general 
Equations  (2.21)  -  (2.26)  with  A  =  1 ,  B  *  1 ,  R  =  r,  C  =  1,  Q 
■  q,  S  *  s,  E  *  o,  G  =  1,  F  =  1,  H  *  1  and  D  =  -a.  The 
corresponding  equations  in  backward  time  (r*  T  -  t)  are 


k  (T)  =  (  1  -  ±  k  { t ) )  k  (t) +  k  (r )+  q;  k  (0)  =  s  (3.72) 

X  IT  X  X  x  x 


kxc(T)  =  (  1  -  ?  kx(T))  kxc(T)  "  q  ;  kxc(0)  =  "S  {3'73) 


kxz(T)  -  (1  -  a  -  ?  kx(T))  kx2  (t)  +  kx  (t)  ;  (3>74) 

kxz  (0)  =  0 


kc(T) 


-  ?  kxc2  +  q  '•  kc  (0)  =  s 


(3.75) 


•>.  - 

$ 
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k  (  i  ) 
cz 


-ak„,  f  l  1 


--  k  )  k 
i  x;*.  xe 


kcz  {0} 


k  .  ( x  ) 


rt  k.:  -  r  Kz  +  -kx2  ;  k2(0)  “  0 


As  in  l ho  case  oL  the  constant  d  is tut banco ,  the 
state  vaLues  ot  k^  ( r )  and  k^  ( i  )  are  found  to  be 


k  x  =*  r  ( l  +  ✓  q/r  +  1 ) 


-q 


xc 


nj/r  +  T 
Equation  (1.74)  has  the  solution 


k  (r) 
xz 


X 


(  i  -  a-  !  k  ) 
r  x 


and 


-  1  +  e 


( 1  -a  -  -  k  )  i 
r  x 


k«  •  lim  k**<T|- 


-  E 

_ X _ 

(  1  -  n-  -  k  ) 
r  x 


{  3 . 7 1> ) 

(3.77) 
s  toady - 

(3.70) 

(3.79) 

J  ( 3.80) 

(3.81) 
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When  from  Equation  (3.78)  is  substituted  in  Equation 
(3.81)  the  result  is 

r  (  1  +  /q/r  +  1 ) 

kxz  *  - - - -  • 

a  +  /q/r  +  1  (3.82) 

As  t  •*  ®  it  is  found  that  no  steady-state  value  exists  for 
kc(t)  for  general  values  of  q  and  r.  However,  the  asymptotic 
slope  kc  does  exist  in  backward  time,  and  is  given  by 


k  -  lim  k 
c  c 


(X) 


q  +  r 


(3.83) 


It  is  easily  shown  that  Equation  (3.76)  has  the  solution 


k=*(T|  '  5  SXC  (?  1  +  »"”]  '3'84> 

and  therefore 

*  Um  kcz(t|-  -  5  RKC  (?  kxs  -1)  (3.85) 


Substituting  the  known  vaLues  of  kxc  and  kxz  into 
Equation  (J.85)  gives 


1  -  a 


q/r  +  i  L  “  +  v  q/r  + 


(3.86) 


When  the  expression  for  kX2  is  substituted  in  Equation 
(3.77)  the  result  is 


k  =  -2ak  -  r 
z  z 


1  +  v/q/r 


a  +Vq/r  + 


r  (1  +  Vq/r+ 


a  +  vq/r  +1 


(3.87) 


Solution  of  (3.87),  subject  to  the  terminal  condition 
kz  (x  =  o)  =»  kz  (t  =  T)  =  o,  yields  the  expression 


(l_e~2otT)  1  1  +vq/r  +  1 

k_  (t)  =  ;  r  - - - 


a  +  H/  r  +  1 


.  (3.88) 
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In  the  limit  t  -*■  <*>  ,  Equation  (3.88)  yields  the  steady-state 
value 


/ 

- 

1 

1 

1  +v/q/r  +  1 

4 

1  +v/q/r  +  1 

r  .  *  .  , , .  _  r  ! 

4.  9 

k2  «  lim  kz(x)  =  Ja  j ” 

T  4 

Ar  +  1  . 

a  +v/cj/r  +  1 

(3.89) 


which  is  positive  for  all  q  ^  o,  r  >  o,  a  ^  o.  Table  3-7 
summarizes  the  steady-state  values  of  gains  for  the  general 
case  \nd  for  the  special  case  of  q  =  o.  Note  the  existence 
of  steady-state  values  kc,  kcz,  and  ~kz  for  the  special 
case  q  *  o.  These  results  may  be  compared  with  the  constant 
disturbance  case  (Table  3-1)  where  ot  *  o.  A  noteworthy 
special  case  can  be  seen  in  Table  3-7  corresponding  to  the 
value  a  -  1  which  leads  to 

*cz=0  '  °  *  1  '  q  "  0  * 

(3.90) 

Figure  3-10  shows  typical  gain  histories  for  the  case  of  the 
exponentially  decaying  disturbance. 

For  this  example,  steady-state  values  of  9XZ  (see 
Table  3-8 )  are  non-zero,  for  general  non-negative  values  of 
q  and  r.  This  behavior  for  the  case  of  an  exponentially- 
decaying  disturbance  is  in  contrast  with  that  for  the  case 
of  the  constant  disturbance,  where  the  limiting  value  8XZ 


Ill 


LIMITING 


NOTE:  "Limiting  slope"  means  as  x-*-:  :=T-t. 


Figure  3-10.  Typical  forward-time  gain  histories  for  a 
scalar  set-point  regulator  with  an  expo¬ 
nentially-decaying  disturbance  and  distur¬ 
bance-utilizing  control. 


is  zero  for  general  non-negative  values  of  q  and  r.  The 
existence  of  finite  values  of  kz  prevents  the  positive 
utility  region  from  collapsing  for  large  t ,  and  the  larger 


the  value  of  a,  the  larger  the  value  of  8XZ  as  t  -*■  «  . 

For  q  *  o,  it  is  found  that 

lim  tan  0  (t)  =  -  2  (a  +  1)  ,  q  =  o 

A  Z 

1  -*00 

(3.91) 

and  therefore,  when  a  =  o,  the  limiting  value  of  9XZ  is 
-63.43  degrees,  which  is  the  same  value  obtained  for  the 
case  of  a  constant  disturbance.  Thus,  for  the  exponential 
disturbance,  the  limiting  angle  is  more  negative  than  -63.43 
degrees. 

Steady  state  values  of  8CZ  are  particularly  sensitive 
to  a;  the  value  a  »  1  is  the  critical  point  which  determines 
whether  positive  or  negative  values  of  0CZ  are  obtained  as 
r  -*■  00  *  .  Table  3-8  lists  some  typical  values  of  8CZ  and 


3.3.2  A  Numerical  Example;  A  Scalar  Regulator  with 
Non-Zero  Set-Point  and  Exponentially-Decaying  Disturbance. 
In  this  example,  the  scalar  system  of  the  previous  examples 
is  operated  as  a  non-zero  set-point  regulator  with  an 
exponentially-decaying  disturbance,  where 


*Note  that  kcz  (in  Table  3-7)  changes  sign  as  a  changes  from 
values  less  than  1  to  values  greater  than  1. 
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TABLE  3-8.  PROPERTIES  OF  THE  POSITIVE-UTILITY  DOMAIN 
"OPENING”  ANGLES  0  xz  AND0cz  FOR  SCALAR 
SET-POINT  REGULATOR  WITH  EXPONENTIALLY  DE 
CAYING  DISTURBANCE 


G»xz  (Degrees) 

for  t  -»  <*> 

(steady-state) 

q 

r 

a 

-75.96° 

l 

1 

i 

1 

00 

.Ck 

•u 

0 

l 

1 

10 

-75.96° 

0 

r  >  0 

1 

-65.56° 

0 

1 

0.1 

exz  (Degrees) 
for  i  ■+  0  (at 
terminal  time) 

q 

r 

CL 

O 

O 

O 

0 

.0 

1  v 

o 

o 

A 

u 

a  >  0 

ecz  (Degrees) 

for  r  ■*  <*> 
(steady-state) 

q 

r 

CL 

-68.96° 

1 

1 

0.1 

-*-80.37° 

1 

1 

10.00 

+90.00° 

q  >  0 

r  >  0 

a  -*■  00 

00.00° 

0 

r  >  0 

a  >_  0 

00.00° 

q  >  0 

r  >  0 

1 

©cz  (Degrees) 

for  i  -*•  0  (at 
terminal  time) 

q 

r 

a 

+90.00° 

q  >  0 

r  >  0 

p 

1  V 

o 
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w(t)  -  -  16.1  e“0-lt  ;  a  =  0.1  (3.92) 

and  xSp  ■  -10.0.  The  numerical  solutions  of  the  six 
unilaterally-coupled  differential  equations  (3.66)  -  (3.71) 
for  this  example  are  shown  in  Figure  3-11.  Note  that 
steady-state  solutions  exist  for  all  six  gains  in  Figure 
3-11 .  The  performance  of  the  disturbance-utilizing  con¬ 
troller  is  summarized  in  Figure  3-12  and  Table  3-9.  Those 
results  may  be  compared  with  the  results  obtained  for  the 
constant  disturbance  (Figure  3-9  and  Table  3-6 ) .  The  x-z 
trajectory  for  the  present  example  lies  in  the  positive 
utility  domain  for  about  the  last  one  second.  Compared  with 
the  constant  disturbance  case  yTable  3-6)  the  DL'C  in  the 
present  case  requires  sligntiy  more  control  energy,  because 
less  "free  energy"  is  available  in  the  decaying  disturoance. 
Likewise,  the  LQ  regulator  requires  less  energy  in  the 
present  case,  when  compared  with  Table  3-6,  Decause  it  nas 
less  disturbance  to  overcome.  The  LC  controller  \ Figure 
3-12 )  shows  the  effect  of  the  disturbance  oy  driving  the 
state  x  to  a  large  set-point  error  (altnough  not  as  large  as 
in  the  case  of  the  constant  disturbance'.  The  disturbance¬ 
utilizing  controller  achieves  large  positive  values  of 
and  #£,  showing  that  the  DUG  is  much  more  effective 
than  the  LQ  regulator,  in  terms  of  miss-distance  and  energy 


consumption 


TABLE  3-9.  COMPARISON  OF  PERFORMANCE  OF  DISTURBANCE¬ 
UTILIZING  CONTROLLER  AND  CONVENTIONAL  LQ 
CONTROLLER;  SCALAR  REGULATOR  WITH  NON-ZERO 
SET-POINT  AND  EXPONENTIALLY  DECAYING  DIS¬ 
TURBANCE:  w ( t )  =  -16.1  e-0*1  xsp  - 
-10.0,  x(o)  =  30.0,  s  *  1,  q  *  o,  r  =  1, 

T  =  6.0 
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3 . 4  A  Second-Order  Plant  with  Zero  Set-Point  and  an 
Exponentially  Decaying  Vector  Disturbance 

3.4.1  General  Results.  In  this  example,  we  consider 

the  system 


x 


=  X2  +  Wl(t) 


=  U  +  W2  (t) 


which  may  be  written  in  vector-matrix  format  as 

x  =  Ax  +  Bu  +  Fw 
y  -  C  x 


(3.93) 


(3.94) 


(3.95) 


(3.96) 

(3.97) 


where  the  disturbance  w  is  assumed  to  be  a  two-dimensional 
vector  whose  elements  are  decaying  exponentials  of  the  form 


wx(t)  =  C1e“alt  *  Zl  (3.98) 

w2(t)  =  C2e'a2t  =  z  2 


(3.99) 


Following  the  disturbance-modeling  procedures  outlined  in 
Chapter  I,  we  have 
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*1  =  "  al  zl  +  °1  (t) 


(3.100) 


z 


2  = 


a2Z2  + 


'2  (t) 


(3.101) 


W  =  H  Z  ; 


O' 

1. 


(3.102) 


z 


DZ  ; 


(3.103) 


where  a^,  (t)  and  a2 ( t)  are  sparsely-populated  impulse 
sequences.  The  relevant  system  parameters  for  this  example 
are 


The  two  control  objectives  for  this  example  are  to 
achieve  simultaneous  set-point  regulation  of  the  two  stater 
*l(t),  X2(t),  while  efficiently  utilizing  any  available 
energy  of  the  disturbances.  These  objectives  will  be 
achieved  by  minimizing  the  performance  index 
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.  T 

1  eT  (T)  Se  (T)  +^J  [eT  ( t) Qe ( t )  +r  (u°  ( t)  )  2]  dt  (  3  .  L04  ) 


where  e(t)  =  x  -  x(t)  .  Q,  S  and  r  tor  this  example  are 

4 :]. •  ■[: :] ..... 


As  T'*>x  f  steady-state  values  exist  for  the  matrices 
Kx(t),  Kxz(t)  and  Kz ( t )  ,  because  the  pair  [A,  B]  is 
completely  controllable  and  D  is  the  system  matrix  of  the 
asymptotically  stable  system  Equation  (3.103).  Therefore, 
the  conditions  for  the  existence  of  solutions  of  the 
algebraic  equations  involving  Kx,  Rxz  and  Kz  are  auto¬ 
matically  satisfied,  as  was  shown  in  Chapter  II.  The  three 
algebraic  (matric)  equations  to  be  solved  for  the  case 
r  -m»  are 


(-A+BR-1BTKx)  -  K  A  -  CTQC  =0  (3.105) 

(-A  +BlT1BTK  )  R  -  K  FH  -  R  D  *  0  (3.106) 

X  XZ  X  X  z 

-(K2D  *  DTK2)  .  KXZBR-1BTK1IZ  -  [(FM)TKxz  +  Kxz™]  -  0(3.107) 
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Substitution  tor  a,  l),  etc.  in  these  equations  leads  to 
twelve  simultaneous  algebraic  equations  to  be  solved.  When 
these  equations  are  solved,  the  tollowinq  expressions  are 
obtained  tor  the  steady-state  qain  matrices: 


K 


x 


(3.108) 


r**l  J 2  axc^  t  1  ) 

(a2r‘s  +  j!  a,  r**  +  1) 
1  1 


xz  ■  I 


J2  +  a1r'*) 


(a2  r*5  +  j 2  c^r**  +1) 


r 


(a 


v»  _  l 

+  J2  01,  r’ 


+  1) 


(3.109) 


r  (  <J2  a2  r*  +  1  ) 

2  *1  r  *» 

(oi^r  +  s/2  a2r'  +  1  ) 


It  is  noted  that  tor  the  special  case  u ^  ■  o,  a  ^  -  o 
Equation  (3.109)  yields: 


lim  K 


xz 


a^O 


a2-*0 


[72  r 


0’ 

r 


(3.110' 
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The  elements  of  Kz  are  found  to  be  expressed  as  follows: 


5al 

♦77T  r  *  X) 


2  *5  —  W 

(a^r*  +  J2  a^r  +  1  ) 


(3.111  ) 


k  »  k 
Z12  Z*1 


«2r  [(a,  a.,  +  ex ^ 2 )  r*3  +  ^2  (a^  +  a 2  ) r<*  +  1  ] 

(a^  +  a2)  (a^r13  +  /2  +  1)  (ci^r*3  +yja2r'1  +1) 


(3.112) 


r  (  y/2  a-r**  +  1)  (2  a  2  r*1  +  1) 

k2  «  - - - - - - -  (3.113) 

22  2  a,(a,2r^  t  J~2  a^r1*  +  1  )2 

4im  *.  4- 


3.4.2  A  Numerical  Example.  Let  T  *  6.0,  =*  -16.1, 

l'2  *  -16.1,  01  j.  *  0.1  and  01 2  “  0.7.  The  latter  values 
imply  that 

(3.114) 

The  computed  gain  matrices  Kx(t),  Kxz(t)  and  Ks(t)  for 
this  example  are  shown  in  Figures  3-13  and  3-14.  Note  that 
the  elements  of  each  matrix  approach  steady-state  values  for 
t-*®  in  this  example.  Of  particular  interest  in  Figure  3-13 


is  the  fact  that  kx^(T)  =  10,  which  results  from  the 
weighting  of  10  on  the  position  state  in  the  terminal 
weighting  matrix  S.  The  remaining  elements  of  Kx  are  zero 
at  t  5  T,  of  course,  because  the  remaining  elements  of  S  are 
zero.  The  DUC  uses  both  matrices,  Kx(t)  and  Kxz(t), 
while  the  LQ  controller  uses  only  the  Kx(t)  matrix.  The 
matrix  Kz(t)  in  Figure  3-14  is  not  required  for  imple¬ 
menting  the  DUC  control  law,  but  is  used  in  computing  burden 
and  utility  for  analysis  purposes. 

The  control  histories  for  the  DUC  and  LQ  controllers  are 
shown  in  Figure  3-15.  The  DUC  accomplishes  most  of  its 
control  action  early  in  the  control  interval,  while  the  LQ 
controller  must  develop  a  significant  amount  of  control  near 
the  end.  This  appears  to  be  due  to  the  fact  that  the  LQ 
controller  takes  cognizance  of  the  disturbance  only  through 
the  effects  that  the  disturbance  has  on  the  states  of  the 
plant,  while  the  DUC  has  current  information  on  the 
disturbance . 

The  plant  state  history  (Figure  3-15)  shows  the  action 
of  the  LQ  controller  in  driving  x^(T)  to  a  negative  value 
(-6.6  feet)  in  response  to  the  negative  disturbance;  the 
DUC,  however,  drives  xi<T)  much  closer  (to  within  0.05 
feet)  to  the  desired  set  point  in  the  face  of  the  same 
disturbance.  The  DUC  also  produces  a  smaller  value  of 
X2(T),  although  no  terminal  weighting  was  placed  on  .2(T)* 

The  utility  (Figure  3-15)  has  a  large  positive  value  at 
t  *  o,  but  is  quickly  driven  negative,  evidently  because  of 


Figure  3-13.  Computed  gain  matrices  Kx(t)  and  KX7(t) 

for  a  second-order  plant  with  disturbance 
utilizing  controller;  exponentially- 
decaying  vector  disturbance  with  a  1  =  0.1 
and  a  2  *  0. 7  . 
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Figure  3-14. 


Computed  gain  matrix  Kz(t)  for  a  second-- 
order  plant  with  disturbance-utilizing  con¬ 
troller;  exponentially-decaying  vector  dis¬ 
turbance  with  ai  *  0.1  and  a 2  *  0.7. 
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the  negative  value  of  xj  near  t  =  1.  After  X2  becomes 
positive  at  t  3  2 ,  the  utility  becomes  positive  again,  and 
remains  so  until  the  terminal  time  at  t  ■  6.  It  should  be 
noted  that  this  example  is  not  designed  to  achieve  ultimate 
utility,  since  Q  is  not  zero.  The  particular  Q  matrix 
chosen  in  this  example  encourages  the  position  state  x^(t) 
to  be  driven  rather  quickly  to  a  small  value,  as  Figure  3-15 
shows.  There  is,  therefore,  a  trade-off  between  keeping 
X]Jt)  small  and  efficiently  utilizing  the  disturbance  in 
this  example.  Even  so,  a  significant  amount  of  positive 
utility  is  "made  available"  by  the  disturbance-utilizing 
control . 

Table  3-10  shows  that  the  DUC  is  more  effective  than  the 
LQ  controller  on  the  basis  of  performance  index  J,  position 
(x^)  set-point  error,  velocity  {X2)  set-point  error  and 
control  energy  consumption.  This  is  reflected  in  the  large 
positive  values  for  the  effectiveness  parameters  . 

'^Ml,  and  ^*E •  Relative  to  the  stated  control  ob¬ 

jectives  for  this  example,  the  disturbance-util iz  ing  con¬ 
troller  achieves  a  position  set-point  error  of  -0.05  feet, 
compared  with  6.6  feet  for  the  LQ  controller  and  consumes 
only  40%  as  much  control  energy  as  the  LQ  controller. 
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Figure  3-15.  Computed  performance  of  second-order 
disturbance-utilizing  zero  set-point 
regulator  with  asymptotically-decaying 
vector  disturbance;  wi(t)  »  -16.1  exp 
(-0.1  t),  W2 ( t )  »  -16.1  exp  (-0.7  t), 
x ]_ ( o )  *  30.,  T  »  6.0,  r  -  1, 
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TABLE  3-10.  COMPARISON  OF  PERFORMANCE  OF  DISTURBANCE¬ 
UTILIZING  CONTROLLER  AND  CONVENTIONAL  LQ 
CONTROLLER;  SECOND-ORDER  REGULATOR  WITH 
ZERO  SET-POINT,  VECTOR  DISTURBANCE  WITH 
w^(t)  -  -16.1  exp  (-0.1  t),  Wo ( t )  *  -16.1 
exp  (-0.7  t),  x.  (o)  »  30.,  x2(o)  ■  0., 

T  =  6.0,  r  =  1, 
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CHAPTER  IV 

APPLICATION  OF  DISTURBANCE-UTILIZING 
CONTROL  THEORY  TO  SOME  MISSILE  -  INTERCEPT  PROBLEMS 


4 . I  Summary  of  Chapter  IV 

This  chapter  discusses  the  application  of  disturbance¬ 
utilizing  control  theory  to  missile  guidance  problems  con¬ 
sisting  of  interception  of  air  defense  targets  and  homing  on 
ground-based  targets,  in  the  face  of  realistic  disturbances. 

The  air  defense  problems  are  studied  by  using  a  general 
planar  model  and  solving  for  the  optimal  (disturbance- 
utilizing)  control  forces  along  the  interceptor  missile's 
longitudinal  and  lateral  axes.  The  problems  of  homing  on 
ground-based  targets  are  studied  via  a  so-called  "small 
line-of-sight  angle"  model  and  solving  for  the  optimal 
(disturbance-utilizing)  control  forces  normal  to  a  reference 
line-of-sight  line  passing  through  the  target  position. 

In  each  case  the  closed-loop  performance  of  the  miss  le 
with  disturbance-utilizing  control  is  analyzed  in  terms  of  a 
performance  index  J  and  related  key  parameters  such  as  term¬ 
inal  miss  distance,  control  energy  requirements,  and  fuel 
expenditure.  In  addition,  the  "effectiveness"  of  .he 
disturbance-utilizing  controller  is  determined,  in  each 
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intercept/homing  problem,  by  comparing  its  performance  with 
that  of  the  corresponding  conventional  linear-quadratic  con¬ 
troller,  under  identical  disturbance  input  conditions. 

4 . 2  A  Planar  -  Motion  Missile  -  Intercept  Problem  with 

Maneuvering  Target  and  Disturbance-Utilizing  Control 
4.2.1  Mathematical  Model.  In  this  section  we  will  be 
concerned  with  problems  of  miss ile- intercept  -  tasks  of 
maneuvering  the  position  of  an  interceptor  missile  so  as  to 
coincide  with  the  position  of  an  air  target  -  in  the  face  of 
disturbance  effects  which  may,  or  may  not,  be  detrimental  to 
the  intercept  objective.  The  geometry  for  a  planar-motion 
version  of  this  problem  is  shown  in  Figure  4-1,  where  the 
origin  of  the  coordinate  system  is  located  at  an  arbi¬ 
trarily  specified  ground  point  and  where,  at  each  time  t, 
the  target  position  (XTl,  XT3)  and  missile  position  (XMl, 

XM3 )  are  dependent  on  the  initial  conditions  at  time  tc 
and  on  the  respective  applied  forces,  including  disturbance 
forces . 

The  forces  applied  to  the  missiles  are  assumed  to  be  the 
net  horizontal  and  vertical  components  mu^  and  mu-,,  re¬ 
spectively,  of  the  control  force  (thrust  components',  and 
the  net  horizontal  and  vertical  components  mwm^  and 
mwm2»  respectively,  of  the  disturbance  forces  that  may  be 
acting  on  the  missile.  The  parameter  m  is  the  mass  of  the 
missile;  u^  and  U2  are  the  horizontal  and  vertical  mis¬ 
sile  accelerations,  respectively,  due  to  control  forces ; 
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Figure  4-1.  Geometry  of  planar-motion  missile-intercept 
problem. 

and  wmi  and  wm2  are  the  horizontal  and  vertical  missile 
accelerations,  respectively,  due  to  disturbance  forces. 

The  horizontal  acceleration  wmi(t)  of  the  missile  due 
to  disturbances  will  be  modeled  as  the  superposition  of  two 
terms 


wml (t)  =  WINDl  +  D  1 


where  WINDl  is  the  horizontal  missile  acceleration  caused  by 
wind  forces  and  D1  is  the  horizontal  acceleration  caused  by 
aerodynamic  drag  forces.  Likewise,  the  vertical  acceler¬ 


ation 


wm2<t)  of  the  missile,  due  to  disturbances,  is 


modeled  as 


132 


Wm2(t)  =  WIND2  +  D  2  +  GRAV  (42) 

where  WIND2  is  the  vertical  missile  acceleration  caused  by 
wind  forces,  D2  is  the  vertical  acceleration  due  to  aero¬ 
dynamic  drag  and  GRAV  is  the  acceleration  of  the  missile  due 
to  gravity  force. 

It  is  assumed  that,  from  the  viewpoint  of  the  inter¬ 
ceptor,  the  motion  of  the  target  is  "uncontrollable"  and  is 
not  known  a  priori.  Thus,  the  target  motion  may  be  viewed 
as  being  caused  by  the  horizontal  and  vertical  target  dis¬ 
turbance  forces  mt  wt^(t)  and  wt2(fc)»  respectively. 

It  is  convenient  to  formulate  this  intercept  problem 
using  the  relative  motion  model 


X1  =  x2 

(4.3) 

• 

x2  -  u^  +  w^Ct) 

(4.4) 

x3  *  X4 

(4.5) 

x4  =  u2  +  w2 (t) 

(4.6) 

y  =  (xlf  x2,  x3,  x4)T 

(4.7) 

where  x^  and  are  the  horizontal  and  vertical  posi¬ 
tions,  respectively,  of  the  missile  relative  to  the  target 
and  x-  and  x,  are  the  horizontal  and  vertical  time  de- 
rivatives  of  and  x^,  respectively.  The  corresponding 
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mu^ 


i  x3  RELATIVE  POSITION,  VERTICAL 


mw2  (t)  l 


+- 

INTERCEPTOR 

MISSILE 


mw^ ( t) 


.mu. 


TARGET 


X1  RELATIVE 
POSITION, 
HORIZONTAL 


Figure  4-2.  Relative  motion  coordinate  system  for 

planar-motion  missile-intercept  problem. 


relative  coordinate  system  is  shown  in  Figure  4-2,  where  the 
origin  is  located  at  the  target  position. 

This  choice  of  relative  coordinate  system  facilitates  the 
representation  of  all  forces  acting  on  the  target  and  mis¬ 
sile  as  net  forces  acting  solely  on  the  missile. 

The  horizontal  acceleration  of  the  missile  produced  by 
this  net  force  is 


where  W]_(t)  is  the  relative  horizontal  disturbance-induced 
acceleration  of  the  missile  with  respect  to  the  target,  and 
is  defined  by 


w1  (t) 


wml  (t)  -  wtl  (t) 


(4.9) 


1 
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The  vertical  acceleration  produced  by  the  net  force  on  the 
missile  is 


un  +  w2 (t) 


(4.10) 


where  the  disturbance-induced  relative  vertical  acceleration 
of  the  missile  with  respect  to  the  target  is 


w2(t)  -  wm2(t)  -  wfc2(t) 


(4.11) 


It  is  assumed  that  on-line,  real-time  measurements  of 
each  of  the  plant  states  are  available  from  high-quality 
track  data,  so  that  the  output  vector  y  has  x^,  x2 ,  x3, 
and  x4  as  its  four  elements. 

Equations  (4.3)  -  (4.7)  may  be  written  in  the  compact 

form 


where 


x 


Ax  +  Bu  +  Fw 


(4.12) 


y  -  C  x 


(4.13) 


0  10  0 
0  0  0  0 
0  0  0  1 
0  0  0  0 


A 


(4.14> 
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It  is  assumed  for  this  problem  that  the  unknown  dis¬ 
turbances  w^  and  W2  can  be  accurately  modeled  as 
random-like  linear  combinations  of  constants  and  linear 
functions  of  time  (ramps)  as  follows: 


w^ft)  =  +  C2t 


(4.20) 


w 2 (t)  =  C3  +  C4t 


(4.21) 


where  Cj_,  C2/  C3  and  C4  are  unknown  "constants" 
which  may  change  from  time-to-time .  Equations  (4.20)  and 
(4.21)  may  thus  represent,  at  each  time  t,  any  possible  com¬ 
bination  of  bias  and  ramp  disturbances  in  the  control  inter¬ 
val  £t0,  T  !]  In  accordance  with  standard  DAC  protocol,  it 
is  assumed  that  the  jumps  in  the  are  not  spaced  "too 
closely"  along  the  time  axis. 

The  dynamic  model  representing  the  disturbance  process 
is  constructed  by  finding  a  system  of  differential  equations 
which  w^(t)  and  W2(t)  satisfy.  For  the  assumed  wavefori.. 
descriptions,  Equations  (4.20)  and  (4.21),  such  a  system  is 


Z1  -  z2  +  °Ult) 

(4.22) 

z2  "  °12 (t) 

(4.23) 

z3  =  Z4  +  °21(t) 

(4.24) 

2 4  -  o22  (t) 

(4.25) 

(4.26) 
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w 


2 


(4.27) 


where  the  represent  sparsely-populated  impulse 

sequences . 

Equations  (4.22)  -  (4.27)  may  be  written  in  compact  form 
as 


where 


and 


z  =  D  z  +  a  (t) 


(4.28) 


w  =  H  z 


(4.29) 


'0  1  0  0 

0  0  0  0 

0  0  0  1 

0  0  0  0 


(4.30) 


(4.31) 


a  (t) 


(4.32) 


It  should  be  noted  that  there  is  a  distinction  between 
the  assumed  disturbance  model  represented  by  equations 
(4.2G)  and  (4.29)  and  the  disturbance  inputs  that  will 
actually  be  used  in  later  simulation  runs  made  for  this 
problem.  The  actual  disturbance  inputs  in  this  problem  fall 
into  two  categories; 


±  — VJi 
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(a)  Inputs  with  waveform  structures  that  are  modeled 
exactly  by  Equations  (4.28)  and  (4.29);  for  instance:  grav¬ 
ity  effects  (a  constant  acceleration),  and  target  maneuvers 
(a  combination  of  ramps  and  constant  levels  of  accele¬ 
ration)  . 

(b)  Inputs  having  waveform  structures  that  are  modeled 
approximately  by  Equations  (4.28)  and  (4.29);  for  instance: 
acceleration  disturbances  due  to  aerodynamic  drag  on  the 
missile  (a  slowly  varying  nonlinear  function  of  time),  and 
acceleration  due  to  wind  (also  a  nonlinear  function  of  time, 
but  often  a  more  rapidly-varying  function  than  drag). 

The  specific  disturbance  waveforms  used  in  the  simula¬ 
tion  studies  of  particular  cases  are  discussed  in  Section 
4.2.3. 

4.2.2  Control  Objectives.  The  planar  missile-intercept 
problem  will  be  formulated  as  a  zero  set-point  regulator 
problem,  where  the  primary  control  objective  is  to  regulate 
the  relative  position  states  x^  and  X3  close  to  zero. 

The  secondary  objective  is  to  accomplish  the  primary  ob¬ 
jective  in  such  a  way  as  to  utilize  any  "free"  energy  which 
may  be  available  in  disturbances  such  as  winds,  aerodynamic 
drag,  gravity  and  target  maneuvers. 

These  dual  objectives  will  be  met  by  minimizing  the 


quadratic  performance  index 
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J  =  J 


ei (T) Se (T)  +  i  / 


eT  (t) 


Qe (t)  +  u  (t)Ru(t)  dt  (4.33) 


where  e  *  xsp  -x  =  -x,  for  this  zero  set-point  case. 

The  weighting  matrices  S,  Q,  and  R  used  in  this  problem 
are 


sn  0  0  0 
0  0  0  0 
0  0  ® 
0  0  0  0 


(4.34) 


0  0 
0  0 
0  0 
0  0 


0  0 
0  0 
0  0 
0  0 


(4.35) 


(4.36) 
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where  the  constant  values  s^  and  S33  are  specified  in 
the  particular  case  considered.  Recall  (Section  2.3)  that 
it  is  required,  in  general,  that  S  and  Q  be  symmetric,  non¬ 
negative  definite  matrices;  and  it  is  convenient  that 
S  +  Q  be  positive  definite.  However,  since  the  plant 
Equations  (4.3)  -  (4.6)  for  this  problem  are  in  phase  vari¬ 
able  canonical  form,  it  is  permissible  to  relax  these  con¬ 
ditions  to  allow  an  S  matrix  which  has  zero  weighting  on  the 
"velocity"  states  and  allow  a  zero  Q  matrix.  The  control 
objectives  are  achieved  by  minimizing  J  with  respect  to  the 
control  u(t),  subject  to  the  plant  Equations  (4.3)  -  (4.7) 
and  the  disturbance  Equations  (4.28)  and  (4.29). 

4.2.3  Discussion  of  Results.  The  planar  missile- 
intercept  problem  defined  in  Sections  4.2.1  and  4.2.2  is 
solved  by  applying  the  theory  of  Section  2.4,  which  leads  to 
the  composite  state  vector 


X 


(4.37) 


the  composite  system  equation 


•  r  *  1  pu  1  *  r  n  1  r  1^  1 


'V  a 

X 


(4.38) 


The  corresponding  performance  index  (equivalent  to  Equation 
(4.33))  is  then  expressed  as 


J 


uT(t) 


Ru(t)  dt 


(4.39) 


where  S  *  C7  S  C,  C  *  (-CIO]  and  Q  -  CT  Q  C. 

The  optimal  control  for  the  problem  at  hand  is  found 
from  Equation  (2.27)  to  be 

2 I  (4 

xz  J 


-1  T 
=  -  R  iBi 


Kx  * 


+  K 


where  it  is  assumed  that  the  plant  state  x  is  obtained  from 
direct  measurements  of  the  position  and  velocity  of  the 
missile  relative  to  the  target  (as  from  high-quality  radar 
tracking  measurements,  for  example),  and  the  disturbance 
state  z  is  obtained  from  an  ideal  state  reconstructor 
(estimator) . 

The  assumption  of  an  ideal  disturbance  state  estimator 
for  this  problem  may  be  justified  on  two  grounds: 

(a)  Estimation  of  the  disturbance  state  vector  z  may  be 
performed  with  a  high  degree  of  accuracy  if  the  estimator  is 
designed  to  properly  account  for  the  class  of  disturbance 
waveforms  to  be  encountered,  assuming  measurement  noise  is 
negligible.  For  a  design  that  meets  this  criterion,  the 
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required  degree  of  accuracy  is  limited  primarily  by  the 
number  of  integrators  and  amplifiers  used  in  the  design, 
which  can  be  implemented  in  large  numbers  by  inexpensive, 
compact  integrated  circuit  assemblies. 

(b)  The  purpose  of  the  present  work  is  to  investigate 
the  role  of  disturbance  utilization  in  missile-intercept 
problems.  The  assumption  of  ideal  disturbance  state  es¬ 
timates  allows  the  analysis  to  be  clearly  focused  on  the 
disturbance-utilization  aspects  of  the  problem,  as  they  are 
influenced  by  the  waveforms  of  gravity,  and  target  maneuver, 
without  regard  for  effects  of  sensor  imperfections. 

The  gain  matrices  Kx(t)  and  Kxz(t)  in  Equation  (4.40) 
are  obtained  for  this  problem  by  solving  the  matric  dif¬ 
ferential  equations 


Kx  =  (-A+BR_1BTKx)TKx-KxA-CTQC  ;  Kx(t)=CTSC  (4.41) 


Kt  =<-*+B*'1!>TVTkxz-KxFH-KxzD  !  iWt>-°  •  <4-42> 


Although  not  required  for  implementation  of  the  control  law 
Equation  (4.40),  the  equation  for  Kz(t) 
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(K  D+DTK  )  +K  !bR “  1BTK„„-  [ (PH) TK_+K_ *PH 


xz 


KZ(T)  =  0 


XZ 


xz  xz 


']  • 


(4.43) 


will  also  be  solved  to  allow  computation  of  the  utility 
function  for  analysis  purposes.  For  the  simulation 
studies  of  this  problem,  the  matric  functions  of  time 
Kx ( t ) ,  KX2(t)  and  Kz(t)  are  obtained  by  forward-time 
solution  of  Equations  (4.41)  -  (4.43)  on  a  digital  computer 
as  t  progresses  from  to{=0)  to  T.  For  this  purpose,  a 
fourth-order  Runge-Kutta  integration  routine  is  used  on  a 
CDC-6600  computer  (integration  of  the  plant  Equation  (4.12) 
is  also  performed  in  this  way).  Initial  conditions  for  the 
forward  integrations  of  Equations  (4.41)  -  (4.43)  are  ob¬ 

tained  by  first  performing  backward-time  integrations  of 
these  equations,  starting  at  a  specified  terminal  time  T, 
with  the  known  terminal  conditions,  and  integrating  back  to 
the  starting  time  tQ  *  0 .  The  element  values  of  the  re¬ 
spective  gain  matrices  (Kx,  Kxz  and  Kz),  at  t  *  0, 
are  then  saved,  to  be  used  as  the  initial  conditions  for  the 
subsequent  forward- time  runs.  This  procedure  avoids  the 
large  computer  storage  requirements  that  would  otherwise  be 
required  to  store  the  time  functions  KxU),  Kxz(t)  and 
Kz(t).  A  description  of  the  digital  program  used  for 
these  calculations  is  contained  in  Appendix  B. 
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The  disturbance  inputs  actually  used  in  the  simulation 
studies  of  this  problem  are  characterized  as  follows: 

(a)  The  effect  of  gravity  on  the  missile  is  modeled  as 
a  constant  "downward"  acceleration  of  the  missile. 

(b)  The  effect  of  drag  on  the  missile  is  modeled  as  a 
deceleration  caused  by  "base  drag",  neglecting  ariy  ad¬ 
ditional  drag  terms  in  induced  by  a  non-zero  angle  of 
attack.  The  drag  disturbance  deceleration  is  simulated  by 
means  of  the  standard  expression  (directed  opposite  to 
direction  of  missile  velocity  Vm> 

"D  -  I  »vm2  Sm  Vm  <4-44 

where  p  is  the  air  density,  Vm  is  the  total  velocity  of 
the  missile 


Sm  is  the  reference  area  of  the  missile,  m  is  the  mass  of 
the  missile,  obtained  by  a  table  look-up  as  a  function  of 
propellant  burn-time  (Figure  4-3),  and  CD  is  the  missile 
base-drag  coefficient,  which  is  obtained  by  a  table  look-up 
as  a  function  of  the  missile  mach  number  (Figure  4-4 )  .  The 
horizontal  and  vertical  components  of  drag  deceleration  (Dl 
and  D2,  respectively)  are  obtained  by  projecting  wD  along 
the  appropriate  coordinate  axis. 

(c)  The  effect  of  cross  winds  acting  on  the  missile  is 
modeled  by  a  disturbance  acceleration  with  the  waveform 
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in  Figure  4-5,  acting  in  a  direction  normal  to  the  missile 
velocity  vector.  This  waveform  is  based  on  realistic  aer¬ 
odynamic  performance  data  obtained  in  response  to  a  wind 
force  acting  on  a  thrusting  missile.  Although  the  point- 
mass  model  used  in  the  problem  at  hand  lacks  an  explicit 
model  of  ang le-of-attack  (the  angle  between  the  missile 
longitudinal  axis  and  its  velocity  vector  is  assumed  to  be 
zero),  the  wind  model  used  in  this  problem  simulates  the  ef¬ 
fect  of  a  local  updraft  or  downdraft  affecting  a  missile  by 
causing  it  to  develop  a  small  angle-of-attack,  which  pro¬ 
duces  an  aerodynamic  force  normal  to  the  missile's  longi¬ 
tudinal  axis,  which,  in  turn,  causes  an  acceleration  as 
shown  in  Figure  4-5.  This  acceleration  is  applied  along  a 
direction  normal  to  the  missile  velocity  vector.  The  dura¬ 
tion  of  the  acceleration  (modeled  as  a  sine-squared  func¬ 
tion  with  a  peak  value  of  32.2  ft/sec2)  is  based  on  the 
approximate  time  for  an  aerodynamically  stable  missile 


Figure  4-5.  Representation  of  effect  of  wind  disturbance  on 
missile  (WINDM). 
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(of  the  class  considered  in  this  problem)  to  regain  its 
rotational  balance  following  development  of  a  wind-induced 
angle-of-attack.  The  direction  of  the  acceleration  WINDM  is 
such  as  to  move  the  missile  into  the  wind  for  the  type  of 
thrusting  missile  assumed  in  this  problem.  The  trans¬ 
lational  effect  of  winds  occurring  during  thrusting,  as 
distinguished  from  the  rotational  effect  just  described,  re¬ 
sults  in  a  very  small  amount  of  translational  motion,  and 
can  be  neglected  during  the  short  flight  times  considered 
here.  It  is  assumed  in  this  problem  that  the  wind  effect  is 
local  to  the  missile,  and  does  not  affect  the  target. 

(d)  Intentional  target  maneuvers  are  modeled  as  a  dis¬ 
turbance  acceleration  of  the  target  resulting  from  aer¬ 
odynamic  forces  acting  in  a  direction  normal  to  the  tar¬ 
get's  velocity  vector.  It  is  assumed  in  this  problem  that 
the  target  develops  sufficient  thrust  to  just  cancel  its 
aerodynamic  drag,  and  that  the  target's  lift  force  is 
maintained  at  a  level  to  balance  the  gravity  force  on  the 
target;  therefore,  the  target,  in  the  absence  of  intentional 
maneuvers,  would  maintain  a  constant  velocity  and  altitude. 
The  assumed  target  acceleration,  normal  to  its  velocity 
vector,  is  shown  in  Figure  4-6.  The  maximum  value  of  the 
latter  target  maneuver  acceleration  is  128  ft/sec2,  and 
its  direction  is  represented  as  an  uncertain  parameter  in 
the  present  study. 
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Figure  4-6.  Target  maneuver  acceleration  disturbance 
(TMAN). 

4. 2. 3.1.  Subcase  4.2.1  -  Planar-Motion  Intercept. 
Disturbance  Inputs:  (a)  Gravity  (helpful);  (b)  Aerodynamic 
drag  ( non-helpf ul ) .  This  Sub-case  considers  the  performance 
of  a  missile  under  disturbance-utilizing  control  in  a  planar 
intercept  problem  with  the  particular  missile-target  geome¬ 
try  of  Figure  4-7.  This  geometry  represents  the  case  in 
which  the  missile  has  been  delivered,  by  a  previous  mid¬ 
course  guidance  phase,  to  the  position  (-9000  ft  ground- 
range,  +5000  ft  altitude),  with  a  horizontal  velocity  vector 
having  a  magnitude  of  2000  ft/sec.  The  parameter  values  as¬ 
sumed  for  this  Sub-case  are: 


0.  ft 
4000.  ft 


(l)  Initial  target  ground-range 
2'  Initial  target  altitude 
Initial  target  velocity* 


-1000.  ft/sec 
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INITIAL 

MISSILfc 


FT 


Figure  4-7.  Missile  and  target  trajectories  for  Sub-case 
4.2.1,  showing  longitudinal  (U^)  and  normal 
(UN)  disturbance-utilizing  control 
components.  Disturbance  inputs:  (a)  gravity; 
(b)  aerodynamic  drag. 

NOTE:  1  cm  ■  10,000  lbs  for  force  components  U^. 
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(4) 

Initial 

missile  ground-range 

-9000.  ft 

(5) 

Initial 

missile  altitude 

5000.  ft 

(6) 

Initial 

missile  velocity* 

2000.  ft/sec 

(7) 

Disturbances  present:  gravity  and 

aerodynamic 

missile 

drag  (no 

target  maneuver,  no  winds) 

.  Gravity  is 

helpful  (aids  the  intercept)  and  drag  is  counterproductive 
(acts  against  the  intercept). 

(8)  Terminal  state  weighting  matrix: 


0  0 
0  0 
10  0 
0  0 


0  0 
0  0 
0  0 
0  0 


"J 

=  3.0  sec. 


‘Initially  horizontal  to  the  right  in  Figure  4-7 


S  = 


10  0 
0  0 
0  0 
0  0 


(9) 


0 

0 

0 

0 


(10) 


6 


(11)  Specified  terminal  time 


The  resulting  missile  and  target  trajectories  are 
presented  in  Figure  4-7.  The  optimal  disturbance  utilizing 
control  forces  can  be  represented  by  the  two  components  Ul 
and  Un  defined  as  follows: 


Ul  *  control  force  along  the  longitudinal  missile 

axis,  computed  as  the  projection  of  the  optimal 
control  forces  mu^  and  mu2» 


Un  =  control  force  normal  to  the  longitudinal  missile 
axis,  computed  as  the  projection  of  the  optimal 
control  forces  mui  and  mu2* 


A  plot  of  Ul( t )  and  Ufj(t),  shown  at  half-second 
intervals,  is  depicted  in  Figure  4-7. 

The  longitudinal  (Ul) t  normal  (U^),  and  resultant 


URES  >^L 


+  U. 


N 


control  forces  for  Sub-case  4.2.1  are  plotted  in  Figure  4-8. 
Note  that  the  primary  control  requirement  is  for  normal 
(pitch-down)  force  in  this  case.  The  control  forces  in  the 
relative-state  coordinate  system  are  plotted  in  Figure  4-9, 
showing  that  the  primary  control  force  requirement  is  in  the 
vertical  (downward)  direction.  The  horizontal  and  vertical 


state  histories  for  Sub-case  4.2.1  are  shown  in  Figures  4-10 
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and  4-11 .  The  disturbance  histories  for  and  W2,  re¬ 
flecting  the  contributions  of  drag  and  gravity  to  the  hori¬ 
zontal  and  vertical  disturbances,  respectively,  are  shown 
in  Figure  4-12.  Figure  4-13  shows  a  plot  of  the  utility 
function#,  which  remains  positive  for  the  entire  con¬ 
trol  interval  [0  <  t  <  T] .  Although  drag  is  acting  against 
achievement  of  the  intercept,  gravity  is  acting  as  a  help¬ 
ful  disturbance  during  the  interval  [tQ,  T] ,  resulting  in 
a  net  disturbance  effect  which  is  helpful. 

The  performance  Sub-case  4.2.1  is  summarized  in  Table 
4-1  where  the  disturbance-utilizing  controller  (DUC),  using 
the  control  law 

u°-  -  R~V  [K^  x  +  Kx2z]  (4.45) 

is  compared  with  the  so-called  "conventional  linear- 
quadratic  controller,"  called  the  ”LQ"  controller.  The 
LQ  controller  uses  the  familiar  control  law 

u  -  -  R^B7  [Kx  x]  (4.46) 

which  is  the  same  as  Equation  (4.45)  with  Kxz  5  o.  Except 
for  the  difference  in  control  laws,  Equations  (4.45)  and 
(4.46),  the  conditions  under  which  the  comparison  is  made 
are  identical  (i.e.,  identical  disturbance  inputs,  identical 
plants,  identical  geometry,  etc.). 
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Figure  4-8.  Longitudinal  (U^),  Normal  (UN),  and 

Resultant  ( U RES )  of  control  force  for 
Sub-case  4.2.1;  disturbance-utilizing  control. 


Figure  4-9,  Horizontal  (rau}_)  and  Vertical  (mu2)  control 
forces  for  Sub-case  4.2.1;  disturbance¬ 
utilizing  control. 


Figure  4-10.  Horizontal  state  histories:  x^  (relative 
position),  %2  (relative  velocity),  for 
Sub-case  4.2.1;  disturbance-utilizing  control 


Figure  4-11  Vertical  state  histories:  X3  (relative 
position),  X4  (relative  velocity),  for 
Sub-case  4.2.1,  disturbance-utilizing  control. 
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The  various  performance  measures  presented  in  Table  4-1 
are  defined  as  follows: 


Table  4-1.  PERFORMANCE  OF  DISTURBANCE-UTILIZING  CONTROLLER 
COMPARED  WITH  CONVENTIONAL  LINEAR-QUADRATIC 
CONTROLLER  FOR  SUB-CASE  4.2.1. 


NOTE:  SEE  PAGE  157  FOR  DEFINITIONS  OF 

J,  <*T,  EU,  EAU,  <?M^,  4^,  MD  AND 
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The  measure  EU,  computed  by  Equation  (4.49),  is  proportion¬ 
al  to  the  "control  energy"  part  of  the  integral  term  in  the 
performance  index  J  (Equation  4.47).  The  measure  EAU,  com¬ 
puted  by  Equation  (4.50)  is  of  interest  to  control  actuator 
designers,  since  it  gives  an  indication  of  how  much  actuator 
fuel,  or  control  thruster  fuel,  is  consumed  during  a  missile 
flight. 

For  Sub-case  4.2.1,  the  DUC  controller  achieves  a  smal¬ 
ler  performance  index  J  (evidenced  by  a  positive  value  of 
<?T)  .  This  is  the  expected  result,  since  the  LQ  controller 
does  not  have  benefit  of  information  about  the  disturbance 


vector  z  and  does  not  incorporate  the  time-varying  gain 
matrix  Kxz.  The  DUC  also  achieved  a  substantially  smaller 
miss  distance  MD  (evidenced  by  the  large  positive  value  of 
f Md^ '  even  though  the  LQ  controller  achieved  a  smaller 
vertical  miss  distance  (note  the  negative  value  of  <fM  )  . 

The  DUC  required  less  control  energy  EU,  but  slightly  more 
control  fuel  EAU  in  this  flight.  Thus,  the  impressively 
smaller  miss  distance  MD  was  achieved  at  the  expense  of  a 
small  additional  expenditure  of  fuel  (relative  to  the  LQ 
controller)  for  this  sub-case.  Heavier  weighting  on  the 
matrix  S  might  result  in  more  efficient  fuel  consumption 
for  the  DUC  in  this  particular  sub-case. 

The  performance  cited  for  Sub-case  4.2.1  is  based  on  the 
specified  terminal  time  T  3  3.0  seconds.  It  is  of  interest 


to  examine  the  effects  of  using  other  fixed  values  of  T. 
Based  on  an  approach  suggested  by  Prof.  C.  D.  Johnson,  a 


digital  computer  program  was  developed  to  determine  the 
value  of  J  for  a  range  of  values  of  T.  This  program  scans 
the  set  of  values  of  J  thus  obtained,  selects  the  minimum 
value  Jmin  among  them,  and  prints  the  results  of  the  op¬ 
timal  control  problem  which  has  the  particular  terminal  time 
Tmin  which  yields  Jntin*  The  program  first  solves  the 
matric  differential  equations  for  Kx,  Kxz  and  Kz 
(Equations  4.41,  4.42  and  4.43)  _in  backward  time ,  starting 
at  the  given  terminal  conditions.  For  example,  if  it  is  de¬ 
sired  to  scan  over  a  range  of  values  of  T  from  T  =»  0  to  T  * 

6  seconds,  the  matric  equations  will  be  solved  beginning  at 
6  seconds,  using  the  given  terminal  conditions,  and  inte¬ 
grating  until  t  *  0  is  reached.  During  this  backward  inte¬ 
gration  procedure,  intermediate  values  of  the  gain  matrix 
elements  are  stored  at  selected  intervals.  For  instance,  if 
an  interval  of  1  second  is  used,  then  values  of  each  element 
are  stored  at  t  =  5,  4,  3,  2,  1  and  0  seconds.  Figure  4-14 
illustrates  this  procedure  for  one  element  (KXli)  of  the 
16  element  Kx  array  for  Sub-case  4.2.1.  For  this  element, 

the  values  Kv  (5),  K  (4),  K  (3),  K  (2), 

X11  X11  X11  X11 

K*ll(1  )  and  KXll(0)  are  saved  during  backward  inte¬ 
gration  of  the  matric  differential  equation.  Next,  the 
optimal  control  problem  is  solved  in  forward-time,  using 
each  saved  value  as  an  initial  condition  for  a  forward-time 
integration  of  the  matric  differential  equations.  In  the 
example  being  considered,  six  forward-time  optimal  control 
problems  are  solved,  and  J  is  computed  for  each  problem. 
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Figure  4-14.  Typical  history  of  K  . 

X11 

The  program  selects  the  minimum  (Jmin)  these  six  values 
(if  a  minimum  exists)  and  identifies  the  corresponding 
terminal  time  Tmin.  As  an  example,  suppose  the  minimum 
value  of  J  is  found  to  be  associated  with  Tmin  *  3 
seconds;  then,  the  program  makes  one  final  "run  for  the 
record",  using  T  =  Tmin  =  3  seconds  and  the  initial 
conditions  Kx(3),  Kxz(3)  and  Kz(3).  (The  matrices 
Kx  and  Kxz  are  required  for  the  control  law 
implementation;  matrix  Kz  is  used  in  computing  the  utility 
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function,  for  analysis  purposes).  For  the  gain  element 
Kxll'  the  resulting  gain  history,  generated  by  this 
final  forward-time  integration  appears  as  shown  in  Figure 
4-15 .  In  addition  to  providing  the  detailed  data  for  the 
Jmin  case,  the  program  also  outputs  summary  parameters 
such  as  J,  terminal-time  miss  distance  MD  =  J  x  ^ (T)  +  x  ^ (T) 


Figure  4  15.  Forward-time  history  of  Kx^  for  Tmin~-" 
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EU  and  EAU  for  each  value  of  T  in  the  range  scanned.  Values 
of  these  parameters  for  various  values  of  T,  for  the  problem 
conditions  of  Sub-case  4.2.1,  are  presented  in  Figures  4-16 
through  4-19  for  the  disturbance-utilizing  controller,  and 
the  conventional  LQ  controller.  The  minimum  value  of  J  is 
reached  at  T  =  3.0  seconds  for  both  controllers  (see  Figure 
4-16 )  .  The  total  ef  f  ectiveness  <j>  versus  T  is  plotted 
over  the  range  of  T  from  1.5  to  5.0  seconds  (Figure  4-20), 
remaining  positive  for  the  whole  interval.  This  shows  that 
the  disturbance-utilizing  controller  consistently  obtains  a 
lower  performance  index  than  the  LQ  controller. 


J 


Figure  4-16.  Performance  index  J  versus  terminal  time  T, 
Sub-case  4.2.1;  DUC  and  LQ. 


Figure  4-17.  Radial  miss  distance  at  t  3  T  versus  terminal 
time  T,  Sub-case  4.2.1;  DUC  and  LQ. 
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Figure  4-18.  Control  energy  measure  EU  versus  terminal  time 
T,  Sub-case  4.2,1;  DUC  and  LQ. 
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Figure  4-19.  Control  fuel  measure  EAU  versus  terminal  time 
T,  Sub-case  4.2.1;  DUC  and  LQ. 


SEC 


Figure  4-20.  Total  effectiveness  versus  specified 
terminal  time  T  for  Sub-case  4.2.1. 
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4. 2. 3. 2  Sub-case  4,2.2  Planar  -  Motion  Intercept 
with  Disturbances  Inputs: 

a )  Gravity  (helpful) 

b )  Aerodynamic  drag  ( non-helpful ) 

c )  Winds  (non-helpful  in  vertical  direction; 
helpful  in  horizontal  direction)  on  the 
missile 

d)  Target  maneuver  ( non-helpf ul ) 

This  case  considers  the  effects  of  winds  and  target  man¬ 
euvers  on  the  performance  of  a  missile  with  disturbance¬ 
utilizing  control.  All  conditions  and  parameters  in  this 
case  are  identical  with  those  of  Sub-case  4.2.1,  except  that 
two  additional  disturbance  inputs  are  present  in  sub-case 
4.2.2:  namely,  winds  and  target  maneuvers.  The  wind  input 
disturbance  is  defined  by  Figure  4-5,  and  acts  on  the  mis¬ 
sile  as  a  normal  force  (m) (WINDM) ,  where  m  is  the  missile 
mass  and  WINDM  is  the  normal  acceleration  of  the  missile  due 
to  wind.  It  is  assumed  in  Sub-case  4.2.2  that  the  wind 
force  (m) (WINDM),  or  its  horizontal  and  vertical  components 
(m) (WIND1 )  and  (m)(WIND2),  are  acting  on  the  missile  as 
showr  in  Figure  4-21.  Thus,  for  the  geometry  of  Sub-case 
4.2.2,  the  horizontal  component  of  wind  force  is  helpful  in 
driving  the  missile  toward  the  intercept,  but  the  vertical 
component  of  wind  force  is  non-helpful,  since  it  acts  to 
hinder  the  intercept. 

The  target  maneuver  in  Sub-case  4.2.2  has  the  waveform 
described  in  Figure  4-6,  with  a  peak  acceleration  value  of 
128.  ft/sec^  ( 4g ) ,  and  acting  in  a  direction  to  drive  the 
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Figure  4-21.  Normal  wind  force  (m)(WINDM)  and  its 

horizontal  and  vertical  components  (m)(WINDl), 
(m)(WIND2),  respectively,  for  Sub-case  4.2.2. 

target  downward - i.e.,  away  from  intercept.  Thus  a 

non-helpful  target  maneuver  is  assumed. 

The  closed-loop  disturbances-utilizing  control  was 
derived  as  in  previous  cases,  and  the  resulting  missile  and 
target  trajectories  are  shown  in  Figure  4-22.  The 
longitudinal  and  normal  components  of  the  disturbance¬ 
utilizing  control  force  are  also  shown  in  Figure  4-22  at 
selected  moments  of  time.  Note  the  downward  deflection  of 
the  target  trajectory  due  to  the  assumed  target  acceleration 
maneuver.  Although  the  target  applies  a  significant 
magnitude  of  maneuver  acceleration  (4g),  it  is  applied  about 
half-way  into  the  flight  and  the  target  trajectory  does  not 
have  time  to  deviate  very  far  before  intercept  occurs.  The 
effect  of  the  target  maneuver  "disturbance"  on  the  compo¬ 
nents  Ul  and  Un  of  the  disturbance-utilizing  control 
force  can  be  seen  at  t  *  1.5  in  Figure  4-22,  where,  for 
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Figure  4-22.  Missile  and  target  trajectories  for  Sub-case 
4.2.2  showing  longitudinal  (U^)  and  normal 
(Un )  disturbance-utilizing  control  force 
components.  Disturbance  inputs: 

a)  gravity 

b)  aerodynamic  drag 

c)  winds  on  missile 

d)  target  maneuver 

Note:  1cm  ■  10,000  lbs  for  force  components 
UL'  UN* 
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instance,  both  control  components  become  larger  for  a  short 
time  to  accommodate  the  detrimental  effects  of  the  target 
maneuver  "disturbance". 

The  time-histories  of  the  disturbance-utilizing  control 
forces  for  Sub-case  4.2.2  (Figures  4-23  and  4-24)  clearly 
show  how  the  additional  disturbance  effects  due  to  target 
maneuvers  and  winds  are  taken  into  account  by  the 
disturbance-utilizing  controller.  Note,  for  example,  the 
abrupt  changes  in  the  control  forces  over  the  sub-interval 
[t  *  1.1  to  1.6  sec]  due  to  the  onset  of  target  maneuvers. 
The  effect  of  the  wind  on  the  control  forces  can  likewise  be 
seen  during  the  sub-interval  [t  =  1.7  to  2.5  sec] . 

The  time-histories  of  the  relative  state  variables 
(Figures  4-25  and  4-26 )  are  almost  identical  with  the  cor¬ 
responding  time-histories  for  sub-case  4.2.1  (Figures  4-10 
and  4-11),  which  indicates  that  the  disturbance-utilizing 
controller  is  doing  an  effective  job  of  "accommodating"  the 
additional  disturbance  inputs  due  to  target  maneuvers  and 
winds . 

The  relative  accelerations  between  missile  and  target, 
due  to  disturbances,  are  shown  in  terms  of  horizontal  (w^) 
and  vertical  (W2)  components  in  Figure  4-27.  Those  graphs 
show  the  rather  dramatic  changes  in  relative  accelerations 
due  to  the  presence  of  additional  disturbance  inputs  for 
this  sub-case. 

The  effects  on  performance  caused  by  the  additional  dis¬ 
turbances  can  also  be  seen  in  the  time-history  of  utility 
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Figure  4-23.  Longitudinal  (Ujj),  Normal  (U^),  and 

Resultant  (Ur£s)  of  control  force  for 
Sub-case  4.2.2;  disturbance-utilizing 
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Figure  4-25. 


Horizontal  state  histories:  xi  (relative 
position),  X2  (relative  velocity),  for 
Sub-case  4.2.2;  disturbance-utilizing  control. 


Figure  4-26.  Vertical  state  histories:  X3  (relative 
position),  X4  (relative  velocity),  for 
Sub-case  4.2.2;  disturbance-utilizing  control. 
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Figure  4-27.  Relative  accelerations  due  to  disturbances 
wi  (horizontal)  and  W2  (vertical),  for 
Sub-case  4.2.2. 
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(Figure  4-28)  which  is  suddenly  driven  to  a  large  negative 
value  by  the  target  maneuver  input,  beginning  at  1.1  sec¬ 
onds.  Thus,  this  sub-case  is  seen  to  have  a  considerably 
less  favorable  utility  history  than  was  true  for  sub-case 
4.2.1. 

The  performance  summary  for  Sub-case  4.2.2  is  presented 
in  Table  4-2.  The  disturbance-utilizing  controller  for  this 
case  obtains  a  larger  J  than  for  Sub-case  4.2.1,  reflecting 
primarily  the  increased  control  energy  (as  measured  by  EU) 
required  to  accommodate  the  intensified  disturbance  environ¬ 
ment.  It  is  interesting  to  note  from  Table  4-2  that, 
although  the  disturbance-utilizing  controller  achieves  both 
a  lower  J  and  a  lower  terminal  miss-distance  than  the  con¬ 
ventional  LQ  controller,  it  did  not  in  this  case  use  less 
control  energy  as  measured  by  EU.  This  is  not  a  surprising 
occurrence,  since  the  structure  of  the  performance  index  J, 
Equation  (4.39),  leads  to  an  optimal  solution  which  seeks  a 
weighted  balance  between  the  values  of  the  terminal  state 
term  and  the  value  of  the  integral  portion  of  J.  In  Sub¬ 
case  4.2.2,  the  terminal  miss-distance  performance  of  the 
DUC  was  achieved  at  the  expense  of  consuming  a  small  amount 
of  additional  control  energy.  However,  the  DUC  consumes 
less  fuel  than  the  LQ  controller,  for  this  sub-case  as  shown 
by  the  values  of  EAU  in  Table  4-2.  Note  that  the 
disturbance-utilizing  controller  has  positive  total  effec¬ 
tiveness  ,  8  t  *  11.2%,  for  the  selected  terminal  time  of 
T  *  3.0  sec.  The  variation  of  (f-j  versus  various  specified 


Figure  4-28. 


Disturbance  utility  for  Sub-case  4 
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Table  4-2.  PERFORMANCE  OF  DISTURBANCE-UTILIZING  CONTROLLER 
COMPARED  WITH  CONVENTIONAL  LINEAR-QUADRATIC 
CONTROLLER  FOR  SUB-CASE  4.2.2. 
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terminal  times  is  shown  in  Figure  4-29.  Note  that  <*t  re¬ 
mains  positive  up  to  about  4.7  seconds.  The  effectiveness 
would  be  expected  to  be  always  non-negative  (that  is,  the 
disturbance-utilizing  controller  would  be  expected  to  be  at 
least  as  good  as  the  conventional  linear-quadratic  control¬ 
ler  in  handling  an  identical  disturbance  input,  but,  the 
numerical  results  of  Figure  4-29  indicate  that  this  con¬ 
dition  was  not  achieved  beyond  t  ■  4.7  seconds  for  the  cal¬ 
culations  performed  on  Sub-case  4.2.2.  The  reason(s)  for 
this  discrepancy  is  not  known,  but  the  following  two  pos¬ 
sible  sources  of  error  are  proposed  as  contributing  factors: 

(1)  Disturbance  waveforms  consisting  of  linear 
ramps  and  constant  level  segments  (as  assumed  in  the  dis¬ 
turbance  model.  Equation  (4.28)  -  (4.32))  only  afford  an 
approximation  to  the  wind  and  drag  disturbances  actually 
used  as  inputs  in  the  computer  simulation  runs  of  this  pro¬ 
blem.  The  non-ideal  results  in  the  values  of  above  t  » 
4.7  may  reflect  the  error  involved  in  this  approximation 
since  is  a  function  of  the  difference  between  two  large 
but  nearly  equal,  values  of  J  in  this  region.  A  solution  to 
this  problem,  of  course,  is  to  model  the  disturbance  more 
realistically,  possibly  increasing  the  order  of  the  distur¬ 
bance  model.  Equations  (4.28)  -  (4.32).  On  the  other  hand, 
the  level  of  the  existing  approximation  error  may  well  be 
adequate  for  most  practical  intercept  applications. 


Figure  4-29.  Total  effectiveness  versus 
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(2)  The  method  of  obtaining  "initial  conditions" 
for  the  forward-time  computation  of  the  gain  matrices  Kx 
and  Kxz,  as  used  in  this  study,  may  introduce  computa¬ 
tional  errors  in  cases  with  large  values  of  T.  That  is, 
since  some  elements  of  the  matrices  are  very  "flat"  as 
backward-time  approaches  t  =  o,  the  backward-time  integra¬ 
tion  process  may  produce  neighboring  solutions  having  nearly 
identical  values  near  t  =  o.  Figure  4-30  illustrates  this 
phenomenon  for  a  typical  element  of  the  matrix  Kx,  where 
several  gain-histories  have  nearly  the  same  initial  con¬ 
ditions  at  t  =  o.  In  fact,  due  to  the  resolution  limitation 


imposed  by  the  digital  word  size,  there  always  exists  some 
"large"  value  of  T  such  that  two  neighboring  Kx(t)  gain- 
histories  will  have  values  so  close  together  (near  t  =  o) 
that  their  numerical  values  are  represented  by  the  same 
digital  word.  When  this  happens,  it  becomes  impossible  to 
generate  unique  forward-time  gain-histories  for  two  neigh¬ 
boring  backward-time  solutions.  One  way  to  circumvent  this 
problem  is  to  provide  double-precision  computations  for  this 
portion  of  the  program. 


4. 2. 3. 3  Sub-case  4.2.3  -  Planar  -  Motion  Intercept. 


All  Conditions  as  in  Sub-case  4.2.2,  Except  for  Increased 


Terminal  State  Weighting.  It  is  interesting  to  consider  the 
effects  of  the  terminal  state  weighting  matrix  S  on  the  per¬ 
formance  of  a  missile  with  disturbance-utilizing  control. 

The  sub-case  considered  in  this  section  uses  the  S-matrix 


That  is,  the  weighting  of  the  relative  position  states  x^ 
and  X3  is  increased  by  a  factor  of  10  over  that  used  in 
Sub-case  4.2.2;  all  other  parameters  are  identical  with 
those  of  Sub-case  4.2.2. 

The  missile  performance  summary  for  sub-case  4.2.3.  is 
presented  in  Table  4-3,  and  shows  that  the  increased  weight¬ 
ing  on  terminal  miss-distance  provides  a  sharp  reduction  in 
both  x^(T)  and  X3(T),  as  well  as  total  miss-distance, 
for  both  the  disturbance-utilizing  controller  and  the  con¬ 
ventional  linear-quadratic  controller  (compare  with  Table 
4-2 ) .  These  reductions  were  obtained  at  the  expense  of 
slightly  larger  total  values  of  J.  Note  that,  for  Sub-case 
4.2.3,  the  disturbance-utilizing  controller  achieves  much 
lower  terminal  miss-distance  and  also  uses  less  control 
energy  and  less  control  fuel  than  the  conventional  LQ 
controller.  The  disturbance-utilizing  controller  for  this 

case  achieves  significant  total  effectiveness  value  t?T  = 

* 

20.2%.  Figure  4-31  shows  the  total  effectiveness 
versus  terminal  time  T  for  Sub-case  4.2.3,  which  indicates 
that  the  disturbance-utilizing  controller  consistently 
obtains  a  lower  value  of  J  for  various  values  of  T. 


*This  means  that  Jduc  *-s  79.8%  of  Jlq 


TABLE  4-3 .  PERFORMANCE  OF  DISTURBANCE-UTILIZING 

CONTROLLER  COMPARED  WITH  CONVENTIONAL  LINEAR- 
QUADRATIC  CONTROLLER  FOR  SUB-CASE  4.2.3. 


NOTE:  SEE  PAGE  157  FOR  DEFINITIONS  OF 

J,  f  ,  Ell,  KAU,  ,  f  ,  MD  and  f.  . 
1  Mh  Hy  MD 
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Figure  4-31.  Total  effectiveness  versus  specified 
terminal  time  T  for  Sub-case  4.2.3. 
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4 . 2 . 3 . 4  Sub-case  4.2.4  -  Planar  -  Motion  Inter¬ 
cept?  Ground-Launched  Missile.  Disturbance  Inputs: 

a )  Gravity  (non-helpful) 

b )  Aerodynamic  drag  (non-helpful) 

c )  Winds  (non-helpful  in  horizontal  direction, 
helpful  in  vertical  direction.) 

d )  Target  maneuver  (non-helpful) 


In  this  section  we  consider  the  performance  of  a  missile 
with  disturbance-utilizing  control  in  a  ground-launch 
problem  with  difficult  missile-target  geometry  and  highly 
detrimental  disturbance  inputs.  The  geometry  of  the  case  to 
be  considered  is  shown  in  Figure  4-32.  The  parameter  values 
peculiar  to  Sub-case  4.2.4  are: 


a) 

Initial 

target  ground-range 

0.  ft 

b) 

Initial 

target  altitude 

6000.  ft 

c) 

Initial  target  velocity 
(horizontal,  to  the  left 
in  Figure  4-3 2) 

-1000.  ft/sec 

d) 

Initial 

missile  ground-range 

-7000.  ft 

e) 

Initial 

missile  altitude 

0 .  ft 

f) 

Initial 

missile  velocity 

0.  ft /sec 

g)  Disturbances  present:  gravity 
(non-helpful),  aerodynamic  drag 
(non-helpful),  wind  force  on  missile 
(large  non-helpful  component  in  hori¬ 
zontal  direction;  small  helpful  compo¬ 
nent  in  vertical  direction),  target 
maneuver  (4  g's,  evasive  -  non-helpful). 

h)  Terminal  state  weighting  matrix  S  is  as 


follows : 


Figure  4-32.  Missile  and  target  trajectories  for 

Sub-case  4.2.4;  disturbance-utilizing 
control.  Disturbance  inputs: 

a)  Gravity 

b)  Aerodynamic  drag 

c)  Wind  on  missile 

d)  Target  maneuver 
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100  0 

0  oj 

(4.57) 

(4.58) 

k)  Specified  terminal  time  T  =  6.0  sec. 

The  wind  disturbance  force  for  Sub-case  4.2.4  is  ori¬ 
ented  as  shown  in  Figure  4-33.  The  missile  trajectory  for 
this  case  is  nearly  vertical  (about  80  degrees),  and,  there¬ 
fore,  the  horizontal  { non-helpf ul )  wind  force  component 
( m) (WIND1 )  is  much  larger  than  the  vertical  (helpful)  com¬ 
ponent  ( m) ( WIND2 ) .  The  waveform  of  the  wind-induced  ac¬ 
celeration  normal  to  the  missile  (WINDM)  is  defined  by 
Figure  4.5.  The  target  acceleration  for  Sub-case  4.1.4  is  de¬ 
scribed  by  Figure  4-6,  and  is  a  128.  ft/sec2  ( 4g )  evasive 
maneuver  which  drives  the  target  upward  -  away  from 
intercept  . 

The  optimal  disturbance-utilizing  control  for  this  sub¬ 
case  was  computed  as  in  the  previous  intercepts,  and  the  re¬ 
sulting  missile  and  target  trajectories  are  shown  in  Figure 
4-32. 

The  time-histories  of  the  control  force  components  for 
sub-case  4.2.4  (Figures  4-34  and  4-35 )  reflect  the  effects 
of  winds  (between  t  *  1.7  and  t  ■  2.5)  and  target  maneuvers 


(beginning  at  t  *  1.1). 
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VERTICAL 


HORIZONTAL 


Figure  4-33.  Normal  wind  force  (m)(WINDM)  and  horizontal 

and  vertical  components  (m)WINDl,  (m)(WIND2), 
respectively,  for  Sub-case  4.2.4. 
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Figure  4-34.  Longitudinal  (Ug),  Normal  (U{,j),  and 
Resultant  (U^gg)  control  forces  for 
Sub-case  4.2.4;  disturbance-utilizing  control. 
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Figure  4-35.  Horizontal  (mujJ  and  vertical  (mu2> 
control  forces  for  Sub-case  4.2.4; 
disturbance-utilizing  control. 


The  time-histories  of  the  missile  target  states  for 
Sub-case  4.2.4  are  shown  in  Figures  4-36  and  4-37 .  The  ef¬ 
fects  of  the  wind  disturbance  are  seen  in  the  horizontal 
position  and  velocity  states  in  the  interval  [t  =  1.7, 
t  *  2.51.  The  effect  of  the  target's  evasive  maneuver,  and 
the  cumulative  effect  of  drag  on  the  missile,  result  in  a 
slight  decrease  in  relative  vertical  velocity  x4  near  the 
final  time  (see  Figure  4-37 )  . 


I 


-4000 


3000 


Figure  4-36.  Horizontal  state  histories:  xi  (relative 

position) ,  X2  (relative  velocity).  Sub-case 
4.2.4;  disturbance-utilizing  control. 
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Figure  4-37.  Vertical  state  histories:  X3  (relative 
position),  X4  (relative  velocity),  for 
Sub-case  4.2.4;  disturbance-utilizing  control 
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The  net  disturbance  effects  are  seen  in  the  plots  of 
wi  and  W2  in  Figure  4-38,  which  reflect  the  combined  ef¬ 
fects  of  gravity,  drag,  winds,  and  target  maneuvers. 

The  effect  of  w^  and  W2  on  utility  is  seen  in  Figure 
4-39 .  Note  that  &  is  negative  for  the  total  flight,  showing 
the  effect  of  the  highly  detrimental  disturbance  environment 
of  Sub-case  4.2.4. 

The  performance  of  the  missile  with  disturbance¬ 
utilizing  controller  for  Sub-case  4.2.4  is  summarized  in 
Table  4-4.  Note  that  the  disturbance-utilizing  controller 
achieves  positive  total  effectiveness  £>p  even  though  the 
utility  ■ft'  is  always  negative  for  this  case.  This  result  de¬ 
monstrates  applications  of  disturbance-utilizing  control  are 
not  limited  to  those  cases  in  which  the  disturbances  have 
positive  utility  •#.  The  disturbance-utilizing  controller 
for  this  case  produces  significantly  better  performance  than 
the  LQ  controller,  in  terms  of  terminal  miss-distance, 
control  energy  requirements,  and  control  fuel  consumption, 
even  though  the  available  "utility  of  disturbances"  ■P/  is 
never  positive. 

4 . 3  A  Planar  -  Motion  Homing  Intercept  Problem  with 
Fixed  Target  and  Disturbance-Utilizing  Control 

4.3.1  Mathematical  model.  In  this  section  we 
consider  a  homing  intercept  problem  in  which  a  missile  is 
to  be  controlled  during  the  final  phase  of  its  flight  so 
that  its  position  coincides  with  that  of  a  fixed  target  at 
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Figure  4-39.  Di 
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TABLE  4-4.  PERFORMANCE  OF  DISTURBANCE-UTILIZING  CONTROLLER 
COMPARED  WITH  CONVENTIONAL  LINEAR-QUADRATIC 
CONTROLLER  FOR  SUB-CASE  4.2.4. 


a  specified  terminal  time,  even  in  the  face  of  disturb¬ 
ances  which  may,  or  may  not,  be  detrimental  to  the  control 
objective.  The  planar  geometry  for  this  problem  is  shown  in 
Figure  4-40,  where  the  origin  is  located  at  the  fixed  ground 
target  position  and  the  position  of  the  missile  is  defined 
by  the  coordinates  (XM,  YM),  where  XM  is  horizontal 
and  Ym  is  vertical,  relative  to  the  ground. 

It  is  convenient  to  consider  a  reference  1  ine-of-s ight 
(REF  LOS)  passing  through  the  target  and  oriented  at  a  known 
angle  ah  relative  to  the  horizontal  line  XM»  The  REF 
LOS  is  established  a  priori,  and  may  correspond  to  a  desired 
orientation  of  the  1  ine-of-s ight .  A  coordinate  is  es¬ 
tablished  normal  to  the  REF  LOS  (Figure  4-40)  and  it  is  as¬ 
sumed  that  the  missile  begins  the  homing  phase  of  the 
problem  with  a  certain  displacement  x^(o)  and  velocity 
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Figure  4-10.  Coordinate  system  for  small  1 ine-of-s ight 
angle  homing  intercept  model. 

X2<o)  (where  X2  *  x^)  normal  to  the  REF  LOS.  It  is 
assumed  that  a  previous  "midcourse"  guidance  phase  has  de¬ 
livered  the  missile  to  the  beginning  of  t-he  homing  phase  at 
t  ■  tQ;  thus,  non-zero  values  of  x^(o)  and  X2<o)  char¬ 
acterize  the  extent  to  which  the  midcourse  phase  has  failed 
to  enable  the  missile  to  start  the  homing  phase  under  ideal 
conditions.  The  initial  range  to  the  target  and  the  closing 
velocity  are  assumed  given.  The  following  assumptions  are 
made  in  connection  with  this  problem: 

(a)  The  displacement  (t)  of  the  missile  at  any 
time  te[tQ,  T]  during  the  homing  problem  is  small  (and 
hence  the  Une-oC-sight  angle  \  (Figure  4-40)  is  small),  so 
that  the  forces  normal  to  the  LOS  may  be  considered  to  be 
approximately  normal  to  the  REF  LOS. 


(b)  The  missile  is  controlled  by  a  force  mu  (m  is 
the  mass  of  the  missile  and  u  is  the  acceleration  associated 


with  the  control  force)  which  may  be  considered  to  be  normal 
to  the  REF  LOS.  This  type  of  control  may,  for  example,  be 
associated  with 

(1)  A  missile  with  "side-thrusters,"  oriented 
so  that  the  missile's  longitudinal  axis  is  approximately 
along  the  REF  LOS:  or 

(2)  An  aerodynamically  controlled  missile 
(e.g.,  a  missile  controlled  by  the  deflection  of  tail  fins) 
whose  longitudinal  axis  lies  approximately  along  the  REF 
LOS. 

(c)  The  component  of  closing  velocity  (between 
missile  and  target)  along  the  REF  LOS  can  be  considered  to 
be  constant  during  the  homing  problem. 

(d)  The  disturbance  forces  of  primary  interest  are 
those  which  are  normal  to  the  REF  LOS,  represented  by  mw(t) 
in  Figure  4-40,  where  w(t)  is  the  acceleration  normal  to  the 
REF  LOS  resulting  from  disturbance  forces. 

Since  the  initial  relative  range  and  the  closing  veloc¬ 
ity  (constant)  is  given  in  this  problem,  the  time  tz  at 
which  the  relative  range  along  the  REF  LOS  will  become  zero 
is  known  a  priori.  This  value  tz  is  used  as  the  speci¬ 
fied  terminal  time  T  at  which  xi  is  to  be  driven  to  zero 
along  the  coordinate  normal  to  the  REF  LOS.  In  missile 
applications,  T  is  typically  obtained  from  radar  or 
range-finder  data  in  the  form  of  time-to-go  (tqo  *  T  -  t). 


will 


Any  error  in  the  measurement  (or  estimate)  of  tgo 
result  in  a  non-zero  miss  distance  along  the  REF  LOS. 

Errors  in  the  knowledge  of  T  are  not  considered  in  the  pres¬ 
ent  work,  but  have  been  investigated  by  several  authors 
(21],  (22]  in  relation  to  homing  intercept  problems,  and 
current  research  is  underway  at  the  U.  S.  Army  Missile 
Command  to  find  improved  methods  for  estimating  tgo. 

Assumptions  (a)  through  (c)  and  the  associated  geometry 
of  Figure  4-40  define  a  "small  LOS  angle"  missile  homing 
model  like  that  which  has  been  used  by  a  number  of  workers 
[23]  -  [34]  in  applications  including  intercept  and  rendez¬ 
vous  (where  displacement  and  velocity  normal  to  the  REF  LOS 
are  driven  to  small  values  as  t  -*■  T)  .  However,  the  "small 
LOS  angle"  model  is  used  in  the  present  work  in  a  unique  way 
-  disturbances  normal  to  the  REF  LOS  (note  assumption  (d)) 
are  utilized  in  an  optimal  manner.  Former  approaches  either 
ignored  these  disturbances,  or  modeled  them  as  gaussian 
noise  and  used  stochastic  control  approaches  to  cope  with 
them.  The  application  of  the  "small  LOS  angle"  model  to  the 
missile  homing  problem  where  disturbances  are  present 
results  in  a  particularly  straight-forward  imple¬ 
mentation  of  the  linear-quadratic  disturbance-utilizing 
control  theory. 

The  equations  describing  the  motion  of  the  missile 
normal  to  the  REF  LOS  are 
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X2  =  u  +  w  (t)  (4.60) 

y  =  [x1# x2]T  (4.61) 

where  the  output  vector  Y  has  xi  and  X2  as  its  elements 
-  it  is  assumed  that  high-quality  measurements  of  x^  and 
X2  are  available  from  tracking  data.  These  equations  may 
be  written  in  the  form 


x  =  Ax  +  Bu+Fw 


(4.62) 


Y  *  C  X 


(4.63) 


where 


A 


0  1 
0  0 


(4.64) 


(4.65) 


(4.66) 


(4.67) 


It  is  assumed  that  the  disturbance  w(t)  is  a  slowly- 
varying  function  of  time  which  may  be  closely  approximated 
by  linear  combinations  of  constant  levels  and  linear  ramps: 


w(t)  *  Ci  +  C2t 


(4.68) 


where  and  C2  are  unknown  constants.  The  disturbance 
process  is  written  in  state-variable  form  as 


zx  =  z2  +  a1(t) 

z2  =  0  +  a2(t) 


or  in  the  form 


z 


D  z  +  a  (t) 


(4.69) 

(4.70) 


(4.71) 


(4.72) 


w  =  H  z  (4.73) 

where 

°  •  [0  3 

H  -  [l  0]  (4.75) 

and  a(t)  -  [ai  ,  02]  is  a  sparse  vector- impulse  sequence 
occurring  at  unknown  instants. 

The  sources  of  disturbances  considered  in  this  problem 
are  gravity  and  winds  (when  present).  The  gravity  component 
acting  normal  to  the  REF  LOS  is 
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-  32.2  cos  a ^ 

and  a  nominal  value  of  a h  =  30  degrees  is  assumed.  Thus 
the  acceleration  disturbance  normal  to  the  REF  LOS  due  to 
gravity  is  as  shown  in  Figure  4-41. 
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Figure  4-41.  Gravity  disturbance  Cor  homing  intercept 
problem. 

The  acceleration  disturbance  due  to  wind  in  this  problem 
is  modeled  by  the  acceleration  waveform  of  Figure  4-5.  The 
specific  orientation  of  the  assumed  wind  disturbance  rela¬ 
tive  to  the  REF  LOS  will  be  discussed  for  the  specific  cases 
where  wind  disturbances  are  present. 


197 


4.3.2  Control  Objective.  The  primary  control  objective 
for  the  class  of  problems  considered  in  this  section  is  to 
drive  the  displacement  of  the  missile  (normal  to  the  REF 
LOS)  to  zero  at  a  specified  terminal  time  T?  that  is,  to  re¬ 
gulate  the  state  to  zero  at  t  ■  T.  The  secondary  ob¬ 
jective  is  to  achieve  the  primary  objective  while  effect¬ 
ively  utilizing  the  "free"  energy  of  the  disturbance  w(t). 

A  special  case  is  also  considered  (Section  4. 3. 3. ?)  where  an 
additional  objective  is  to  achieve  a  specified  missile  tra¬ 
jectory  approach  angle  at  t  *  T,  while  achieving  the  primary 
and  secondary  objectives. 

The  control  objectives  are  to  be  achieved  by  minimizing 
the  quadratic  performance  index 


1 

I 


(T)  Se  (T)+  i  /  [eT  (t)Qe  (t)+  ru2(tj]dt  (4.76) 


where  e  ■  x3p  -  x  ■  -  x,  subject  to  the  plant  equa¬ 
tions  (4-62)  and  (4-63)  and  the  disturbance  process  equa¬ 
tions  (4-72)  and  (4-73).  The  terminal  state  weighting 
matrix  S  and  the  matrix  Q  will  be  numerically  specified  when 


they  are  used  in  the  specific  cases.  The  control,  weighting 
coefficient  r  is  set  to  1  for  all  cases  to  be  discussed 
here. 

4.3.3  Discussion  of  Results.  The  homing  intercept 
problem  is  solved  by  applying  the  theory  of  Section  2.4, 
which  leads  to  the  composite  state  vector  Equation  (4.37), 
the  composite  system  Equation  (4.38)  and  the  performance 
index  Equation  (4.39).  The  optimal  control  is  computed  by 
Equation  (4.40)  after  computing  the  time-varying  gains 
Kx(t)  and  Kxz( t 1  as  the  solutions  of  Equations  (4.41) 
and  (4.42.).  The  time-varying  gain  Kz(t)  is  also  computed 
(by  solving  Equation  (4.43))  for  use  in  computing  the  dis¬ 
turbance  utility-?/ for  analysis  purposes.  The  problem  is 
solved  on  a  CDC-6600  computer  as  described  for  the  missile 
intercept  problem  in  Section  4.2.3,  using  backward-time 
integration  to  find  the  initial  conditions  for  Kx,  Kxz 
and  Kz . 

The  plant  state  x  for  the  optimal  control  Equation 
(4.40)  is  assumed  to  be  available  from  position  and  velocity 
data  (as  from  high-quality  radar  tracking  measurements,  for 
example) .  The  disturbance  state  vector  z  is  assumed  to  be 
obtained  from  an  ideal  state  reconstructor  (estimator)  for 
this  problem;  the  grounds  for  making  this  assumption  were 
discussed  in  Section  4.2.3  in  connection  with  the  problem  of 
Section  4.2,  and  they  also  apply  to  the  homing  intercept 
problem  of  the  present  section. 
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4  .  J  .  3  .  1  3  ub-case  4.3.1  -  Planar  Homing  Intercept . 

Disturbance  Input:  Gravity  (helpful).  In  this  sub-case  we 
consider  the  per t'ormance  of  a  missile  with  disturbance¬ 
utilizing  control  in  a  planar  homing  intercept  having  the 
missile-target  geometry  as  shown  in  Figure  4-42.  The  para¬ 
meter  values  for  Case  4.3.1  are: 

a)  Fixed  target  at  0.  ft  down-range,  0.  ft 
altitude . 

b)  Initial  missile  ground-range  -6778.  ft 

c)  Initial  missile  altitude  4260.  ft 

d)  Initial  missile  offset  normal 

to  REF  LOS,  X].(o)  300.  ft 

e)  Initial  missile  range  along 

REF  LOS  -8000.  ft 


f ) 

Initial  missile  velocity  normal 
to  REF  LOS,  X2(o) 

0.  ft/sec 

3) 

Missile  velocity  along  REF  LOS 
(constant,  toward  target) 

-2000.  ft/sec 

h) 

Angle  of  REF  LOS  from  horizontal 

30.  deg 

i) 

Specified  terminal  time  T 

4.0  sec 

j) 

Disturbance:  gravity,  helpful 

k) 

Control  weighting  parameter 

1.0 

1) 

:1 

m) 


0  o' 

0  0 


Q 
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This  homing- intercept  problem  was  solved  on  the  CDC  6600 
computer,  and  the  resulting  optimally  controlled  missile 
trajectory  for  Sub-case  4.3.1  is  shown  in  Figure  4-42,  with 
the  associated  disturbance-utilizing  control  force  mu° 
displayed  at  1  second  intervals.  The  optimal  control  u° 
is  computed  by  Equation  (4.40)  as  a  function  of  the  time- 
varying  gain  matrices  Kx  and  Kxz.  The  time-varying  mis¬ 
sile  mass  m  varies  as  shown  in  Figure  4-3.  The  missile  is 
able  to  apply  the  control  force  in  a  direction  approximately 
normal  to  the  missile  trajectory  (assuming  small  angle  of 
attack)  rather  than  normal  to  the  REF  LOS  as  desired.  The 
missile  trajectory  angle  relative  to  the  horizontal  goes 
from  30  degrees  at  t  *  o  to  34  degrees  at  t  »  4.0.  There¬ 
fore,  the  maximum  error  in  the  angle  of  application  of  the 
control  force  is  4  degrees,  which  results  in  the  application 
of  99.8%  of  the  control  force  mu°  normal  to  the  REF  LOS. 

The  time-history  of  the  control  force  requirement  is  shown 
in  Figure  4-43,  which  is  seen  to  be  nearly  a  linear  function 
of  time. 

The  time-histories  of  the  states  and  X2  are  shown 
in  Figure  4-44.  Note  that,  since  no  penalty  has  been  placed 
on  X2(T),  it  has  a  relatively  large  value  of  -140  ft/sec, 
corresponding  to  the  missile  trajectory  angle  which  is  about 
4  degrees  greater  than  the  30  degree  angle  of  the  REF  LOS. 
The  disturbance  for  this  case  (Figure  4-45)  is  the  projec¬ 
tion  of  gravity  normal  to  the  REF  LOS.  The  utility  (Figure 
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4-46 )  is  non-negative  for  the  whole  flight,  as  the  result  of 
the  helpful  action  of  the  disturbance  in  this  sub-case. 

The  performance  of  the  missile  with  disturbance¬ 
utilizing  control  for  this  case  is  compared  with  that  of  the 
conventional  linear-quadratic  controller  in  Table  4-5,  show¬ 
ing  superior  performance  for  the  disturbance-utilizing  con¬ 
troller  in  terms  of  J,  <?T,  EU,  EAU,  xi(T)  and  <*mD, 
where 


J  = 


1 

7 


e  (T)  Se  (T)  + 


1 

7 


fi 


e  (t)Qe  (t)+  r 


u2  (t) 


dt  (4.77) 


mu°  sec 


Figure  4-43.  Disturbance-utilizing  control  force  for 
Sub-case  4.3.1. 
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Figure  4-46.  Disturbance  utility  for  Sub-case  4.3.1. 


TABLE  4-5.  PERFORMANCE  OF  DISTU RBANCE-UTI LI 2 ING  CONTROLLER 
COMPARED  WITH  CONVENTIONAL  LINEAR-QUADRATIC 
CONTROLLER  FOR  SUB-CASE  4.3.1. 


DUC 


LQ 


PERFORM¬ 

ANCE 

INDEX 

J 

,fT 

* 

•■o 

CONTROL 

ENERGY 

EU 

CONTROL 

FUEL 

EAU 

MISS- 

DISTANCE 

NORMAL 

TO  REF  LOS 
*1  <~T) 
(FT) 

,c 

MD 

W 

138.0 

94.9 

137.0 

29.0 

0.4 

96.6 

2722.0 

ss 

2047.0 

113.0 

-11.6 

B 

202  AND  205  FOR  DEFINITIONS 

eu,  eau  and  ,rMD. 


NOTE :  SEE  PAGES 
OF  J,  <rT, 


All  effectiveness  measures  show  a  sizeable  margin  at  T 


4.0.  Values  of  total  effectiveness  <?-£  versus  terminal 
time  values  are  plotted  in  Figure  4-47,  which  indicates  a 
continuing  increase  in  as  T  increases. 

4. 3. 3. 2  Sub-case  4.3.2  -  Planar  Homing  Intercept. 
Disturbance  Input:  Gravity  ( non-helpf ul ) .  Sub-case  4.3.2, 
considered  in  this  section,  examines  the  performance  of  a 
missile  with  disturbance-utilizing  control  in  a  planar 
homing  intercept  configuration  where  the  missile-target 
geometry  (Figure  4-48)  is  such  that  gravity  is  a  non-helpful 
disturbance,  and  the  missile's  offset  from  the  REF  LOS  at  t 
■  o,  x^(o),  is  twice  what  it  was  in  Case  4.3.1.  The 
parameters  for  Case  4.3.2  are  as  follows: 


&  »P 


t  iooH 


80  H 


60H 


40  A 


20  -\ 


0 


0 


x  100% 


Figure  4-47.  Total  effectiveness  versus  specified 
terminal  time  T  for  Sub-case  4.3.1. 
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Figure  4-48.  Missile  trajectory  for  Sub-case  4.3.2,  showing 
control  force  rau°;  disturbance-utilizing 
control.  Disturbance  presents  gravity. 


a) 

Fixed  target  at 
altitude . 

0.  ft  down-range, 

0.  ft 

b) 

Initial  missile 

ground-range 

7228.  ft 

c) 

Initial  missile 

altitude 

3480.  ft 

d; 

Initial  missile 
REF  LOS,  xjjo) 

offset  normal  to 

-600.  ft 

e) 

Initial  missile 
REF  LOS 

range  along 

•8000.  ft 

f) 

Initial  missile  velocity  normal 
to  REF  LOS,  X2 (o ) 

0.  ft/sec 

g) 

Missile  velocity  along  REF  LOS 
(constant,  toward  target) 

•2000.  ft/sec 

h) 

Angle  of  REF  LOS  from  horizontal 

30.  deg 

i)  Specified  terminal  time  T 

j)  Disturbance:  gravity,  nonhelpful 

k)  Control  weighting  parameter  r 
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4.0  sec 


1.0 


1) 


0 

0 


m) 


0 

0 


The  computer  results  were  obtained  for  Sub-case  4.3.2, 
and  the  final  optimally  controlled  missile  trajectory  is 
shown  in  Figure  4-48,  with  the  associated  disturbance¬ 
utilizing  control  force  mu°  displayed  at  1  sec  intervals. 
This  case  has  a  600  ft  initial  offset  from  the  REF  LOS 
(twice  that  of  Sub-case  4.3.1)  and  the  geometry  of  this 
problem  makes  the  gravity  disturbance  non-helpful,  in 
contrast  with  Sub-case  4.3.1.  As  a  result,  the  control 


force  magnitudes  for  this  sub-case  are  considerably  larger 
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Figure  4-49.  Control  force  for  Sub-case  4.3.2;  disturbance¬ 
utilizing  control. 


than  for  Sub-case  4.3.1  (see  Figure  4-49).  The  missile 
trajectory  angle  for  Case  4.2.2  goes  from  30  degrees  at 
t  *  o  to  about  24  degrees  at  t  +  T;  the  maximum  error  in 
the  angle  >f  application  of  the  control  force  is  -6  degrees, 
which  results  in  the  application  of  99.5%  of  the  control 
force  mu°  normal  to  the  REF  LOS.  As  in  Sub-case  4.3.1, 
the  control  force  for  this  case  (Figure  4.49)  is  almost  a 
linear  function  of  time. 

The  time-histories  of  the  states  and  X2  are 
plotted  in  Figure  4-50.  As  in  Sub-case  4.3.1,  no  terminal 
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Figure  4-50.  State  histories:  x^  and  X2  for  Sub-case 
4.3.2;  disturbance-utilizing  control. 

penalty  is  placed  on  x2»  and  a  relatively  large  value 

of  x2(T)  results.  The  disturbance  in  this  case  (Figure 

4-51 ) ,  which  is  the  projection  of  the  gravity  acceleration 

normal  to  the  REF  LOS,  is  non-helpful,  since  it  acts  to 

hinder  the  missile  from  the  intercept  objective.  As  a 

result,  the  disturbance  utility  (Figure  4-52)  is  either 

negative  or  zero  for  the  whole  flight. 

The  disturbance-utilizing  controller  for  Sub-case  4.3.2 
performs  better  than  the  conventional  linear-quadratic 
controller  (see  Table  4-6)  even  in  the  face  of  the  totally 
detrimental  disturbance,  which  indicates  that,  even  though 
positive  utility  is  never  available,  the  disturbance¬ 
utilizing  control  law  still  does  better  in  managing  the 
states  of  the  plant  relative  to  the  disturbance  states. 
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TABLE  4-6.  PERFORMANCE  OF  DISTURBANCE-UTILIZING  CONTROLLER 
COMPARED  WITH  CONVENTIONAL  LINEAR-QUADRATIC 
CONTROLLER  FOR  SUB-CASE  4.3.2. 


PERFORM¬ 

ANCE 

INDEX 

J 

CONTROL 

ENERGY 

EU 

CONTROL 

FUEL 

EAU 

MISS- 

DISTANCE 

NORMAL 

TO  REF  LOS 
*1  (T) 
(FT) 

<? 

%MD 

0.158 

X105 

14.2 

0.157 

xio5 

306.0 

-3.8 

75.8 

0.183 

xio5 

0.171 

XIO5 

358.0 

-15.7 

X 

NOTE:  SEE  PAGES  202  AND  205  FOR  DEFINITIONS 

OF  J,  <?T,  EU,  EAU  AND  <?ME). 


The  effectiveness  (Figure  4-53)  for  Sub-case  4.3.2  shows 
that  the  disturbance-accommodating  controller  continues  to 
achieve  a  lower  J  as  the  specified  terminal  time  is 
increased . 

4. 3. 3. 3  Sub-case  4.3.3  -  Planar  Homing  Intercept 
with  Trajectory  Angle  Specification  at  Terminal  Time.  Dis¬ 
turbance  Inputs: 

a)  Gravity  (helpful) 

b)  Wind  (non-helpf ul ) 

In  this  sub-case  we  consider  the  performance  of  a 
missile  with  disturbance-utilizing  control  in  a  planar 
homing  problem  which  has  the  primary  objective  of 
intercepting  the  target  and  secondary  objectives  of 
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X  100% 


Figure  4-53.  Total  effectiveness*^  versus  specified 
terminal  time  T  for  Sub-case  4.3.2. 

(1)  Achieving  a  specified  orientation  of  the 
velocity  vector  angle  (the  trajectory  angle)  at  terminal 
t ime ,  and 

(2)  Effectively  utilizing  "free"  disturbance 

energy. 

Realization  of  the  angle  specification  leads  to  a  con¬ 
sideration  of  a  terminal  weighting  matrix  S  with  non-zero 
weighting  on  X2(T).  The  missile-target  geometry  for  this 
sub-case  is  shown  in  Figure  4-54.  The  parameter  values  for 


Sub-case  4.3 

.3  are: 

a) 

Fixed  target  at 
altitude . 

0.  ft  down-range, 

0.  ft 

b) 

Initial  missile 

ground-range 

-6778. 

ft 

c) 

Initial  missile 

altitude 

4260. 

ft 
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d) 

Initial  missile  offset  normal  to 
REF  LOS,  x ]_  { o  } 

300.  ft 

e) 

Initial  missile  range  along 

REF  LOS 

9000.  ft 

f) 

Initial  missile  velocity  normal 
to  REF  LOS,  X2 (o ) 

0.  ft/sec 

g) 

Missile  velocity  along  REF  LOS 
(constant,  toward  target) 

2000.  ft/sec 

h) 

Angle  of  REF  LOS  from 
horizontal 

30 .  deg 

i) 

Specified  terminal  time  T 

4.5  sec 

j) 

Disturbances:  gravity 

(helpful)  and  wind 
(nonhelpful) 

k) 

Control  weighting  parameter  r 

1.0 

1) 


S 


50  0 

0  10 


to  achieve  weighting  on  xi(T)  and  X2(T). 


The  optimal  disturbance-utilizing  control  for  sub-case 
4.3.3  was  comp  i ted  as  in  the  previous  homing  intercept  prob¬ 
lems,  ;nd  the  resulting  missile  trajectory  is  shown  in  Fig¬ 
ure  with  the  disturbance-accommodating  control  forces 

displayed  at  selected  times.  Note  the  increased  level  of 
muQ  at  t  =  2.0  (compared  with  the  level  at  t  =  1.0) 
required  to  handle  the  wind  disturbance  which  begins  at  t  = 
1.7  seconds  and  ends  at  t  =  2.5.  The  control  at  t  =  2.5 


reflects  the  wind  disturbance  and  the  requirement  to  achieve 
the  specified  angle  at  t  =  T.  The  result  is  a  reversal  in 
the  sign  of  mu°  for  the  remainder  of  the  flight.  Con¬ 
siderable  control  force  levels  are  required  for  this  case  as 
t  T,  as  distinguished  from  the  previous  cases  (with  no 
angle  specification)  which  had  the  control  approaching  zero 
for  t  •+  T . 

The  effects  of  the  wind  and  the  angle  specification  on 
the  control  are  clearly  seen  in  Figure  4-55,  where  a  large 
transient  is  required  between  t  *  1.7  and  t  *  7.5  to  handle 
the  wind  and  the  control  force  continues  to  increase  as 
t  -*■  T.  No  wind  disturbance  effects  are  seen  in  the  be¬ 
havior  of  the  states  and  xn  ( Figure  4-56 ) ,  indicating 
that  the  disturbance-utilizing  control  is  doing  very  well  in 
accommodating  the  disturbance.  The  effect  of  the  velocity 
weighting  term  in  S  is  seen  as  the  decrease  in  the  value  of 
-\2  as  t  ■*  T.  This  assures  that  the  velocity  vector  of 
the  missile  lies  almost  parallel  to  the  reference  LOS  as 
t  ■*  T;  i.  e.,  along  a  direction  very  close  to  30  degrees 
from  the  horizontal.  To  achieve  an  arbitrary  angle  a ^  re¬ 
lative  to  horizontal,  it  is  only  necessary  to  specify  the 
value  of  aft  at  the  beginning  of  the  problem,  which  auto¬ 
matically  defines  the  and  reference  LOS  coordinates. 

This  feature  of  the  model,  which  was  suggested  in  1351,  is 
applicable  to  a  general  class  of  homing  intercept  problems 
where  the  approach  angle  is  important. 


Figure  4-55.  Control  force  for  Sub-case  4.3.3,  disturbance 
utilizing  control. 


sec  T 


Figure  4-56.  State  histories:  x^  and  X2  for  Sub-case 
4.3.3,  disturbance-utilizing  control. 


•'•W  M^IUKX. 
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Figure  4-57  shows  the  disturbance  inputs  for  this 
problem.  The  wind  disturbance  waveform  is  as  given  in 
Figure  4-5;  the  orientation  of  the  wind  for  Sub-case  4.3.3 
is  along  the  positive  coordinate,  such  that  the  wind 
acceleration  WINDM  of  Figure  4-5  is  tending  to  move  the 
missile  away  from  the  REF  LOS.  The  gravity  component  along 
xi  is  negative,  acting  to  move  the  missile  toward  the  REF 
LOS. 

The  effects  of  the  disturbances  result  in  a  utility 
value  which  is  almost  always  negative  (Figure  4-58)  except 
for  two  very  brief  positive  excursions  resulting  from  the 
derivative  of  the  disturbance.  Recall  that  the  utility 
function  (Equation  2.108)  depends  on  all  elements  of  the 
disturbance  vector  z,  which  includes  *  w  and 
Z2  -  3  w  in  the  disturbance  model  (Equations  (4-69)  - 

(4-73))  being  used). 

The  performance  of  the  missile  with  disturbance¬ 
utilizing  control  is  summarized  in  Table  4,7,  where  it  is 
compared  with  that  of  the  conventional  linear-quadratic 
controller.  The  disturbance-utilizing  controller  achieves  a 
lower  value  of  J  (and  therefore  a  positive  total 
effectiveness  ;  uses  less  control  energy,  based  on  EU ; 
uses  less  fuel,  based  on  EAU ;  and  achieves  a  lower  value  of 
xi(T).  Inclusion  of  terminal  velocity  weighting  in  this 
problem  results  in  trajectory  angles  (at  t  *  T)  of  -0.307 
degrees  and  -1.52  degrees  (relative  to  the  30  degree 
orientation  of  the  REF  LOS)  for  the  disturbance-utilizing 
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TABLE  4-7.  PERFORMANCE  OF  DISTURBANCE-UTILIZING  CONTROLLER 
COMPARED  ITH  CONVENTIONAL  LINEAR-QUADRATIC 
CONTROLLER  FOR  SUB-CASE  4.3.3. 


PERFORM¬ 

ANCE 

INDEX 

J 

2  T 

CONTROL 

ENERGY 

EU 

CONTROL 

FUEL 

EAU 

MISS- 

DISTANCE 

NORMAL 

TO  REF  LOS 
(T) 

(FT) 

2" 

MD 

1 

TRAJECTORY 
ANGLE  ERROR 
AT  t=T 

(DEGREES) 

'A 

x 

0.711 

XIO4 

13.5 

0.652 

X104 

200.0 

0.7 

85.1 

-0.307 

-100 

0.821 

X104 

X 

0.753 

XIO4 

229.0 

-4 . 7 

X 

-0.152 

X 

NOTE:  SEE  PAGES  202,  205,  AND  220 

J,  2 T ,  EU,  EAU,  2  MD  AND  2ft. 


and  conventional  LQ  controllers,  respectively.  This  is 
reflected  in  the  large  negative  value  of  <?A,  where 


error  at  t-T^-langle  error  at  ^’puc  10[|.  (4-82) 
(angle  error  at  t*?)^ 


However,  both  controllers  show  very  good  control  of  the 
trajectory  angle  at  t  ■  T.  Note  that  the  DUC  in  this  sub¬ 
case  achieves  much  smaller  miss-distance  than  the  LQ 


a* 


controller,  at  the  expense  of  a  larger  angle  error  at  t  ■  T. 
In  those  applications  where  larger  trajectory  angle  errors 
can  be  tolerated,  less  weight  may  be  placed  on  the  velocity 
state  (in  matrix  S),  which  should  lead  to  lower  values  of 
control  energy  and  fuel  consumption,  and/or  lower  values  of 
miss-distance  xi(T).  The  total  effectiveness  <fT  for 
this  sub-case  is  positive  for  various  values  of  specified 
terminal  time  T  (see  Figure  4-59),  demonstrating  that  the 
DUC  performance  is  consistently  better  than  that  of  the  LQ 
controller . 


SEC 


x  100% 


.  Total  effectiveness  versus  specified 
terminal  time  T  for  Sub-case  4.3.3. 


Figure  4-59 


CHAPTER  V 


CONCLUSIONS  AND  RECOMMENDATIONS 
FOR  FURTHER  WORK 


5.1  Introduction 

The  research  described  in  this  document  constitutes 
the  first  application  of  disturbance-utilizing  control  the¬ 
ory  to  missile  guidance  problems.  In  fact,  the  work  de¬ 
scribed  herein  is  apparently  the  most  substantial  applica¬ 
tion  of  disturbance-utilizing  control  theory  so  far  attemp¬ 
ted  for  any  control  problem  [38],  This  chapter  presents  the 
conclusions  of  this  research  and  offers  recommendations  for 
further  work. 

5 . 2  Conclus ions 

The  results  of  this  investigation  have  demonstrated 
that,  in  many  cases,  the  disturbance-utilizing  controller 
produces  significantly  better  performance  than  the  con¬ 
ventional  linear-quadratic  controller.  This  superior 
performance  is  realized  even  when  the  relationship  between 
the  plant  state  x  and  the  disturbance  state  z  is  such  that 
the  disturbance  utility  ft  is  never  positive  during  the  con¬ 
trol  interval.  The  concept  of  "effectiveness"  and  associ¬ 
ated  effectiveness  measures  such  as  total  effectiveness 
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<fT,  and  miss-distance  effect iveness  haa  been  intro¬ 
duced  as  a  means  of  relating  practical  aspects  of  the 
performance  of  the  disturbance-utilizing  controller  to  those 
of  a  conventional  linear-quadratic  controller  under  the  same 
conditions.  By  means  of  these  performance  measures  it  has 
been  shown  that  a  large  class  of  missile/target/disturbance 
scenarios  exists  for  which  the  disturbance-utilising  con¬ 
troller  provides  significant  improvements  over  the  con¬ 
ventional  LQ  controller  in  terms  of  practical  criteria  used 
in  the  missile  industry.  For  example,  in  the  seven  mis¬ 
sile  guidance  cases  considered  in  Chapter  IV,  the  terminal 
miss-distance  obtained  by  the  disturbance-utilizing  control¬ 
ler  ranged  from  3.4%  to  56.1%  of  the  terminal  miss-distance 
obtained  by  a  conventional  linear-quadratic  controller  under 
identical  conditions.  In  addition,  although  the  seven  mis¬ 
sile  guidance  cases  of  Chapter  IV  were  designed  with  minimum 
miss-distance  as  the  primary  control  objective,  in  most  cas¬ 
es  the  disturbance-utilizing  controller  required  less  con¬ 
trol  energy  and  less  control  fuel  than  a  conventional 
linear-quadratic  controller.  In  one  homing  intercept  pro¬ 
blem  (Sub-case  4.3.1)  the  control  energy  and  control  fuel 
required  by  the  disturbance-utilizing  controller  were  only 
6.7%  and  25.7%,  respectively,  of  the  control  energy  and 
control  fuel  required  by  a  conventional  linear-quadratic 
controller . 

The  necessary  and  sufficient  conditions  have  been  found 
for  the  existence  of  steady-state  solutions  of  the  six 
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unilaterally-coupled  matric  differential  equations  which 
govern  the  solution  of  the  set-point  and  servo-tracking 
problems  in  disturbance-utilizing  control.  These  conditions 
determine  the  existence  of  steady-state  disturbance-utiliz¬ 
ing  control  laws.  Futhermore,  it  has  been  shown  that  these 
steady-state  solutions,  when  they  exist,  are  solutions  of 
certain  matric  algebraic  equations.  Numerical  computational 
approaches  have  been  suggested  for  obtaining  the  steady- 
state  solutions. 

Several  mathematical/geometric  properties  of  the  util¬ 
ity  function  t*/,  in  the  case  of  time- invariant  systems,  have 
been  found;  namely, 

(a)  An  expression  has  been  obtained  for  the  zero-utility 
boundary,  in  the  set-point  regulator/servo-tracking  distur¬ 
bance-utilizing  problem,  for  the  case  of  p  >  n  +  v  (  p  is  the 
dimension  of  the  disturbance  state  vector  z ,  n  is  the 
dimension  of  the  plant  state  vector  x,  and  v  is  the  dimen¬ 
sion  of  the  set-point  vector  c) . 

(b)  The  size  of  the  positive-utility  domain  in  the  set- 
point  regulator/servo-tracking  disturbance-utilizing  problem 
with  m  n  «  v  *  1  is  described  through  the  introduction  of 
a  new  parameter  9  (the  angle,  in  the  c-z  plane,  between 

C  2 

the  zero-utility  planes) .  This  parameter  is  used  in  con¬ 
junction  with  the  previously-used  paramenter  9xz  (the  an¬ 
gle,  in  the  x-z  plane,  between  the  zero-utility  planes)  to 
allow  a  graphical  interpretation  of  the  size  of  the 
positive-utility  domain  throughout  the  control  interval. 
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(c)  The  limiting  behavior  of  the  utility  f unct ion  -i/{  t ) 
and  its  derivative  d*V/dt  has  been  determined  for  t  -►  T  (i.e, 
at  the  terminal  time)  and  for  the  steady-state  condition 
(where  "backward-time"  r  -►  «  ).  in  addition,  the 

critical-point  condition  which  characterizes  the  location  of 
maximum  -tV  with  respect  to  z  in  (x,  c,  z)-space  has  been 
derived. 

In  this  document,  derivations  have  been  presented 
for  the  steady-state  gain  expressions  associated  with 

(1)  a  scalar  regulator  with  a  constant  disturbance,  for 
both  the  zero  set-point  and  non-zero  set-point  cases; 

(2)  a  scalar  regulator  with  an  exponentially-decaying 
disturbance,  for  both  the  zero  set-point  and  non-zero  set- 
point  cases;  and 

(3)  the  zero  set-point  regulator  with  a  second-order 
plant  and  a  vector  (two-dimensional)  disturbance. 

In  addition,  numerical  solutions  have  been  obtained  for 
each  case,  which  allow  the  performance  of  the  disturbance¬ 
utilizing  controller  to  be  compared  with  that  of  a  con¬ 
ventional  linear-quadratic  controller. 

The  robustness  of  the  disturbance-utilizing  control  law 
relative  to  a  mismatch  between  the  disturbance  model  and 
actual  disturbance  inputs  has  been  examined  in  this  study. 
Several  missile  guidance  cases  are  considered  in  which  dis¬ 
turbance  inputs  (e.g.,  aerodynamic  drag  and  winds)  are  ap¬ 
proximately  modeled  by  the  assumed  mathematical  disturbance 
process.  Specific  cases  of  intercept  problems  have 
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indicated  that  the  match  between  drag  waveforms  and  the 
assumed  "step  plus-ramp"  second-order  disturbance  model  is 
excellent.  Some  performance  degradation  can  be  detected 
when  the  faster-changing  wind  waveforms  are  experienced,  but 
the  overall  effectiveness  remains  high  as  long  as  the  faster 
modes  of  the  waveforms  do  not  constitute  a  dominant  part  of 
the  disturbance.  Whether  or  not  one  should  attempt  to  mod¬ 
ify  the  mathematical  disturbance  model  to  obtain  a  closer 
match  to  real-life  disturbance  waveforms  depends  on  the 
results  of  a  trade-off  between  increased  design  complexity 
and  incremental  performance  improvement  to  be  gained. 

A  unique  digital-computer  analysis  tool  (DUCAT  — 
Disturbance-Utilizing  Control  Analysis  Technique)  has  been 
developed  for  implementing  the  disturbance-utilizing  control 
law,  the  equations  of  the  plant  being  controlled,  and  the 
disturbance  models.  The  computer  program  also  implements 
the  corresponding  conventional  linear-quadratic  control  law 
for  comparative  analysis  in  terms  of  the  effectiveness  of 
the  disturbance-utilizing  control  law.  A  key  feature  of 
DUCAT  is  the  capability  of  obtaining  the  "T-Minimin"  value 
of  the  optimized  performance  index  J°[VJ  for  a  given  distur¬ 
bance  utilizing  or  conventional  linear-quadratic  problem. 

The  program  determines  the  optimal  values  J°£t^  for  a 
selected  set  of  values  of  specified  terminal  times  T^  in 
some  specified  interval  TmaxJ*  Then»  the  program 

selects  the  minimum  optimal  value  J°in  among  that  set  and 
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then  displays  the  optimal  control  and  trajectory  for  the 

particular  T  .  corresponding  to  J° .  . 

mm  r  ^  min 

The  control  of  an  air  defense  interceptor  missile  in  the 
face  of  a  disturbance  environment  consisting  of  gravity,  aer¬ 
odynamic  drag,  winds,  and  target  maneuvers  has  been  found  in 
the  context  of  a  general  planar  geometry  configuration.  In 
this  approach,  the  components  of  the  disturbance-utiliz¬ 
ing  control  are  determined  along  the  missile's  longitudinal 
and  lateral  coordinates.  The  problem  of  controlling  a  hom¬ 
ing  missile  to  a  ground-based  target  in  the  face  of  gravity, 
winds,  and  a  specified  trajectory  approach  angle  has  been 
solved  by  using  a  so-called  "small  line-of-sight  angle" 
geometry,  in  which  the  disturbance-utilizing  control  force 
is  found  as  a  force  normal  to  a  reference  line-of-sight 
passing  through  the  target  position.  Although  the  "small 
line-of-sight  angle"  homing  model  as  applied  herein  is  used 
for  fixed-target  cases,  this  model  may  also  be  applied  to 
the  disturbance-utilizing  control  of  a  missile  in  an  air  de¬ 
fense  role  against  a  maneuvering  target.  The  disturbance¬ 
utilizing  controller  is  seen  to  be  well  suited  to  ac¬ 
commodating  typical  target  maneuver  waveforms. 

5 . 3  Recommendations  for  Further  Work 

The  present  study  has  uncovered  several  areas  for 
further  work  in  disturbance-utilizing  control  theory.  In 
particular,  it  is  suggested  that  further  work  be  directed  as 
follows: 
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(a)  The  application  of  disturbance-utilizing  control 
should  be  considered  for  a  three-dimensional,  6-degree-of- 
freedom  missile  intercept  model  with  complex  aerodynamics, 
control  limits,  autopilot  dynamics,  and  a  non-ideal  state- 
reconstructor.  This  would  be  a  logical  follow-on  to  the 
present  work.  Computational  algorithms  for  obtaining  the 
time-varying  gain  matrices  Kx(t)  and  Kxz(t)  should  also 

be  investigated  as  part  of  this  appl ications-or iented  task. 

(b)  The  application  of  disturbance-utilizing  control  to 
a  discrete  missile  control  problem  would  be  useful,  in  view 
of  the  trend  toward  using  sampled-data  and  microprocessor 
techniques  in  future  missile  designs.  Relevant  work  in  this 
area  includes  investigating  ways  to  obtain  the  time-varying 
gain  matrices  for  this  problem  via  solutions  of  difference 
equations  or  by  implementation  of  alternative,  discrete 
algorithms  for  generating  these  matrices.  Other  work  may 
include  the  formulation  of  the  discrete  plant/disturbance 
state  reconstructor  (estimator)  for  the  discrete  missile 
control  problem. 

(c)  The  design  of  the  performance  index  for  disturbance¬ 
utilizing  control  appears  to  be  a  fruitful  area  for  further 
study.  One  question  of  particular  interest  is  how  to  choose 
the  performance  index  parameters  S,  Q,  and  R,  in  the  general 
case,  to  maximize  utility  and  effectiveness.  Also,  how  to 
enhance  utility  and  effectiveness  (possibly  by  using  time- 
varying  parameters  0  and  R)  during  critical  parts  of  the 
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control  interval,  such  as,  for  example,  near  the  terminal 
time.  Another  question  of  interest  is  how  to  choose  S,  Q, 
and  R  in  a  systematic  way  to  achieve  missile  trajectory 
shaping  and  to  reduce  the  sensitivity  of  intercept  perfor- 
formance  to  errors  in  estimating  time-to-go.  In  this  re¬ 
gard,  results  from  the  homing  intercept  Case  4.3.3  of  the 
present  work  indicate  that  the  use  of  non-zero  weighting  on 
the  "velocity"  state  at  terminal  time  (in  the  S  matrix) 
produces  terminal  performance  which  is  less  sensitive  to  the 
choice  of  specified  terminal  time  T  than  for  the  standard 
intercept  problem  where  only  the  position  states  are 
weighted . 

(d)  An  investigation  of  multi-mode  disturbance- 
accommodation  in  the  missile  guidance  problem  should  be 
profitable.  For  example,  some  missile  intercept  scenarios 
may  call  for  a  combination  of  disturbance  absorption/ 
minimization  and  disturbance-utilization.  An  interesting 
question  in  this  regard  is  how  to  relate  mode-switching 
criteria  to  utilization  and  effectiveness  levels,  recog¬ 
nizing  that  positive  effectiveness  may  be  obtained,  in  the 
disturbance-utilizing  mode,  even  when  the  utility  is 
negative.  The  design  of  disturbance-absorbing  controllers 
by  the  generalized  "algebraic/stabilization  method"  [39]  may 
be  useful  in  such  problems. 

(e)  A  systematic  method  for  finding  a  dynamic  mathema¬ 


tical  model  corresponding  to  actual  measurements  of  real- 


life  disturbance  wavotoniis  would  be  especially  useful  in 
applications  such  as  missile  intercept,  where  the  composite 
disturbance  waveform  may  bo  quite  complex.  A  related  useful 
area  of  study  would  be  the  investigation  of  a  systematic 
way  to  choose  a  disturbance  model  with  a  specified  level  of 
approximation  error  relative  to  an  expected  disturbance 
waveform. 

(t)  Many  potential  applications  of  d  isturbance-ut  i  1 1/.  inq 
control  are  suqqosted,  in  both  requlator  and  servo-tr ack inq 
problems,  by  the  critical  need  to  conserve  enerqy  and  fuel. 
The  efficiency  of  the  d isturbance-ut  i  l  is inq  approach  is 
read  i  ly  seen  in  the  cases  considered  in  the  present  study, 
where  s  ign i t  leant  savinqs  ot  control  enerqy  and  control  l no L 
eonsumpt ton  are  realised.  Other  candidate  applications  tor 
appreciable  savinqs  tn  control  enerqy  and  fuel  appear  to  be 
automobile  speed  and  steer  inq  control,  aircraft  fliqht  path 
controL  and  fully  automatic  land  inq  system;,  ship  steer  inq 
systems,  point  inq  and  trackinq  systems  tor  larqe  antenna 
arrays  and  spacecraft,  control  in  the  presence  of  distur¬ 
bances  such  as  gravitational  fields. 


REFERENCES 


1.  Johnson,  C.  D.  "Theory  of  Disturbance-Accommodating 
Control.,"  Control  and  Dynamic  Systems,  Advances  in 
Theory  and  Applications,  VoY~.  12 ,  Academic  Press,  New 
York ,  19"/  6 . 

2.  Bryson,  A.  E.,  Jr.  and  Ho,  Y.  C.,  Appl ied  Optimal 
Contro 1 ,  Blaisdell  Publishing  Company,  Waltham,  Massa¬ 
chusetts,  1969. 

3.  Med  itch,  J.  S.,  Stochastic  Optimal  Linear  Estimation 
and  Control,  McGraw-Hill  Book  Company,  New  York,  1969 . 

4.  Sage,  A.  P.,  and  White,  C.  C.,  Ill,  Optimal  Systems 
Control ,  Second  Edition,  Prentice-Hall,  Inc., 

Englewood  Clifts,  New  Jersey,  1977, 

5.  Johnson,  C.  D. ,  "Accommodation  of  Disturbances  in 
Optimal  Control  Problems,"  International  Journal  of 
Control ,  Vol.  15,  No.  2,  19  7?,  pp.  209-231 

6.  Johnson,  C.  D. ,  "Accommodation  of  External  Disturbances 
in  Linear  Regulator  and  Servo-mechanism  Problems,"  IEEE 
Transactions  on  Automatic  Control,  Vol.  AC-16,  No.  51 
December  l9'7l,  pp.  535,644. 

7.  Johnson,  C.  D. ,  "Utility  of  Disturbances  in 
Disturbance-Accommodating  Control  Problems,"  Proc 1 s 
15th  Annual  Meeting  of  the  Society  for  Engineering 
Science;  <3a  insv  i  1  le ,  Florida,  De  cember ,  1 5  7  S  . 

8.  Athans,  M.,  and  Falb,  P.  L. ,  Optimal  Control  -  An 
Introduction  to  the  Theory  and  Its  Applications,- 
McGraw-Hill  Book  Company,  New  York,  1965 . 

9.  Barnett,  S.,  Matrices  in  Control  Theory,  Van  Nostrand 
Re inhold  Company ,  London,  1971. 

10.  Johnson,  C.  D. ,  "A  Preliminary  Study  of  Disturbance  Ab¬ 
sorbing  Controllers  for  Servo-Mechanism  Problems,"  US 
Army  Missile  Command  Report  No.  RL-TR-71-15,  Redstone 
Arsenal,  Alabama,  December  1971. 

11.  Johnson,  C.  D. ,  Proceedings  of  1973  ASME  Winter  Annual 
Meeting ,  Detroit^  Mich  igan ,  Paper  No.  73-WA/Aut  -  7, 
November  11-15,  1973. 

231 


232 


12. 

Johnson,  C.  D. ,  ASME  Trans.  J. 

Dynamic  Systems, 

Measurements  and  ControL,  Series  G, 

96,  1,  1974.  p.  25. 

13. 

Johnson,  C.  D.  and  Skelton,  R. 

E., 

Proceedings  11th 

JACC ,  Atlanta,  Ga.,  June  1970; 
TTT 1971. 

also 

in  AIAA  J.  9,  T, 

14.  Wiberg,  D.  M.,  State  Space  and  Linear  Systems,  McGraw- 
Hill  Book  Company,  New  York,  1911 . 


15.  Kalman,  R.  E.,  "Contributions  to  the  Theory  of  Optimal 
Control,"  Bol .  Soc .  Mat.  Mexicana,  1960,  pp.  102-119. 

16.  Dressier,  R.  M.  and  Larson,  R.  E.,  "Computation  of 
Optimal  Control  in  Partially  Controlled  Linear  Sys¬ 
tems,"  IEEE  Transactions  on  Automatic  Control,  October 
1969,  pp.  575-511. 

17.  Anderson,  B.  D.  0.  and  Moore,  J.  B.,  Linear  Optimal 
Control,  Prentice-Hall,  Inc.,  Englewood  Cliffs,  New 
Jersey,  1971. 

18.  Kreindler,  E.,  "On  the  Linear  Optimal  Servo-Problem," 
International  Journal  of  Control,  Vol.  9,  No.  4,  1969, 
pp.  465-472. 

19.  Bellman,  R. ,  Stability  Theory  of  Differential 
Equations,  McGraw-Hill  Book  Company,  New  York,  1953. 

20.  Bellman,  R. ,  Introduction  to  Matrix  Analysis,  McGraw- 
Hill  Book  Company,  New  York,  I960” 

21.  Pastrick,  H.  L.  and  York,  R.  J.,  "On  the  Determination 
of  Unspecified  tf  in  a  Guided  Missile  Optimal  Control 
Law  Application,"  Proceedings  of  1977  IEEE  Conference 
on  Decision  and  Control,  197 1 . 

22.  Pastrick,  H.  L.  and  York,  R.  J.,  "Optimal  Control 
Applications  for  Missile  Systems,  Report  TG-77-2,  US 
Army  Missile  Research  and  Development  Command,  February 
1977.  (Classified  Confidential). 

23.  Bryson,  A.  E.,  "Linear  Feedback  Solution  for  Minimum 
Effort  Interception,  Rendevous  and  Soft  Landing,"  AIAA 
Journal ,  Vol.  3,  No.  8,  August  1965,  pp.  1542-1544. 

24.  Ho,  Y.  C.,  Bryson,  A.  E.,  and  Baron,  S.,  "Differential 
Games  and  Optimal  Pursuit-Evasion  Strategies,"  IEEE 
Transactions  on  Automatic  Control,  Vol.  AC-10,  No.  4, 
October  196S,  pp.  385-389. 


L 


23 

25.  Kishi,  F.  H.  and  Bettwy,  T.  S.,  "Optimal  and 
Sub-optimal  Designs  of  Proportional  Navigation 
Systems,"  in  Proceedings  of  the  Symposium  on  Recent 
Advances  in  Optimization  Techniques,  John  Wiley  and 
Sons,  New  York,  1965. 

26.  Stallard,  D.  V.,  "Classical  and  Modern  Guidance  of 
Homing  Interceptor  Missiles,"  Raytheon  Company,  Missile 
Systems  Division,  Bedford,  Massachusetts.  Presented  to 
Seminar  of  Department  of  Aeronautics  and  Astronautics, 
Massachusetts  Institute  of  Technology,  April  1968. 

27.  Willems,  G.  C.,  "Optimal  Controllers  for  Homing 
Missiles,"  US  Army  Missile  Command,  Redstone  Arsenal, 
Alabama,  1968,  Report  No.  RE-TR-68-15. 

28.  Deyst,  J.  J.  and  Price,  C.  F.,  "Optimal  Stochastic 
Guidance  Laws  for  Tactical  Missiles,"  AIAA  Journal 
Spacecraft  and  Rockets,  Vol.  10,  No.  5,  May  147$, 
pp.  361-368. 

29.  Kreindler,  E.,  "Optimality  of  Proportional  Navigation," 
AIAA  Journal,  Vol.  11,  No.  6,  June  1973,  pp.  878-880. 

30.  Stockum,  L.  A.  and  Weimer,  F.  C.,  "Optimal  and 
Suboptimal  Guidance  for  a  Short-Range  Homing  Missile," 
IEEE  Transactions  on  Aerospace  and  Electronic  Systems, 
Vol.  AES-12,  No.  3,  May  1976, pp.  355-360. 

31.  Speyer,  J.  L.,  "An  Adaptive  Terminal  Guidance  Scheme 
Based  on  an  Exponential  Cost  Criterion  with  Application 
to  Homing  Missile  Guidance,"  IEEE  Transactions  on  Auto¬ 
matic  Control,  May  1976,  pp.  371-375. 

32.  Nazaroff,  G.  J.,  "An  Optimal  Terminal  Guidance  Law," 

IEEE  Transactions  on  Automatic  Control,  June  1976,  pp. 
407-408. 

33.  Kim,  M.  and  Grider,  K.  V.,  "Terminal  Guidance  for  Im¬ 
pact  Attitude  Angle  Constrained  Flight  Trajectories," 
IEEE  Transactions  on  Aerospace  and  Electronic  Systems, 
Vol.  AES-9 ,  November  1973,  pp.  852-859. 

34.  York,  R.  J.  and  Pastrick,  H.  L.,  "Optimal  Terminal 

Guidance  with  Constraints  at  Final  Time,"  AIAA 
Journal  Spacecraft  and  Rockets,  Vol.  14,  No .  6 .  June 
1 5777  _pp  .1ST-  3'  S'  T. - 


i 


m 


i 


234 


35.  Balbirnie,  E.  C.,  Sheporaitis,  L.  P.,  and  Merriam,  C. 
W.,  "Merging  Conventional  and  Optimal  Control 
Techniques  for  Practical  Missile  Terminal  Guidance," 
AIAA  Guidance  and  Control  Conference,  1975,  Paper 
75-1127. 

36.  Johnson,  C.  D. ,  "On  Observers  for  Systems  with  Unknown 
and  Inaccessible  Inputs,"  International  Journal  of 
Control,  Vol.  21,  No.  5,  191^,  pp.  d 2 5 - 8 i  1“. 

37.  Johnson,  C.  D.,  "Improved  Computational  Procedures  for 
Algebraic  Solution  of  the  Servomechanism  Problem  with 
External  Disturbances,"  Transactions  of  the  ASME, 
Journal  of  Dynamic  Systems,  Measurement,  and  Control, 
June  1975,  pp.  161-163. 

38.  Johnson,  C.  D.  "Disturbance-Accommodating  Control;  A 
History  of  Its  Development",  Proceedings  15th  Annual 
Meeting  of  the  Society  for  Engineering  Science;  Gaines- 
ville ,  Florida,  December  1978. 

39.  Johnson,  C.  D.  "Design  of  Disturbance-Accommodating 
Controllers  By  the  Algebraic/Stabilization  Method", 
Proceedings  of  the  First  International  Symposium  on 
Policy  Analysis  and  Information  Systems,  Session  No. 
SA-VI  on  Disturbance-Accommodating  Control  Systems, 

Duke  University,  June,  197^. 


BIBLIOGRAPHY 


1.  Johnson,  C  .D.,  "Optimal  Control  o£  the  Linear 

Regulator  with  Constant  Disturbances,"  IEEE 
Transactions  on  Automatic  Control,  Vol.  AC-13,  No.  4, 
August  1968,  pp  416-421.  ~ 

2.  Johnson,  C.  D. ,  "Further  Comments  on  'Optimal  Control 
of  the  Linear  Regulator  with  Constant  Disturbances'," 
IEEE  Transactions  on  Automatic  Control,  Vol.  AC-15,  No. 
4,  August  1970,  pp.  516-513. 

3.  Johnson,  C.  D. ,  "Further  Study  of  the  Linear  Regulator 
with  Disturbances-The  Case  of  Vector  Disturbances 
Satisfying  a  Linear  Differential  Equation,"  IEEE 
Transactions  on  Automatic  Control,  Vol.  AC-15,  No. 

2,  April  1970,  pp.  222-228. 

Johnson,  C.  D.  and  Gibson,  J.E.’,  ^Optimal  Control  with 
Quadratic  Performance  Index  and  Fixed  Terminal  Time," 
IEEE  Transactions  on  Automatic  Control,  October  1964, 
pp.  355-360. 

5.  Johnson,  C.  D.,  "Stabilization  of  Linear  Dynamical  Sys¬ 
tems  with  Respect  to  Arbitrary  Linear  Subspaces, " 
Journal  of  Mathematical  Analysis  and  Applications, 

Vol .  44 ,  No.  1,  October  1973 ,  pp .  173-186 . 

6.  Johnson,  C.  D. ,  "A  Unified  Canonical  Form  for  Control¬ 
lable  and  Uncontrollable  Linear  Dynamical  Systems," 

Int.  J.  Control,  1971,  Vol.  13,  No. 3,  pp.  497-517. 

7.  Johnson,  C.  D. ,  "Optimal  Control  with  Chebyshev  Mini¬ 
max  Performance  Index,"  Transactions  of  the  ASME, 
Journal  of  Basic  Engineering,  June  1^67,  pp.  251-262 . 

8.  Johnson,  C.  D.,  "Invariant  Hyperplanes  for  Linear 
Dynamical  Systems,"  IEEE  Transactions  on  Automatic  Con¬ 
trol,  January  1966,  pp.  113-116 . 

9.  Johnson,  D.  D. ,  "Control  Laws  for  Missile  Intercept, 
Rendevous,  and  Tracking  vie  Disturbance  Accommodation 
Techniques,"  US  Army  Missile  Command  Report  No. 
RD-CR-75-1,  June  1974. 


235 


236 


10.  Kalman,  R.E.  and  Koepcke,  R.W. ,  "Optimal  Synthesis  of 
Linear  Sampling  Control  Systems  Using  Generalized 
Performance  Indexes,"  Transactions  of  the  ASME, 

November  1958,  pp.  1820-1826. 

11.  Kalman,  R.E.  and  Bucy,  R.S.,  "New  Results  in  Linear 
Filtering  and  Prediction  Theory."  Transactions  of  the 
ASME,  Journal  of  Basic  Engineering,  March  1961,  pp 
95-108. 

12.  Kalman,  R.E.,  "Mathematical  Description  of  Linear 
Dynamical  Systems,"  S.I.A.M.  Journal  of  Control,  Ser. 

A,  Vol.l,  No. 2,  1963,  pp.  153-192. 

13.  Kalman,  R.  E.,  "When  Is  a  Linear  Control  System 
Optimal?",  Transactions  of  the  ASME,  Journal  of  Basic 
Engineering ,  March  1964,  pp.  51-60. 

14.  Kalman,  R.  E.  and  Englar,  T.  S.,"  A  User's  Manual  for 
the  Automatic  Synthesis  Program  (Program  C),"  NASA, 
Washington,  D.  C.,  June  1966. 

15.  Wonham,  W.  M.,  "On  A  Matrix  Riccati  Equation  of 
Stochastic  Control,"  S.I.A.M.  Journal  of  Control,  Vol. 
6,  No.  4,  1968,  pp.  681-697. 

16.  Gantmacher,  F.  R. ,  "The  Theory  of  Matrices,"  Vols.  I 
and  II,  Chelsea  Publishing  Company,  New  York,  New  York, 
1960. 

17.  Bryson,  A.  E.,  Jr.,  "Applications  of  Optimal  Control 
Theory  in  Aerospace  Engineering,"  AIAA  Journal  of 
Spacecraft  and  Rockets,  Vol.  4,  No.  5,  May  1967,  pp. 
545-553. 

18.  Garber,  V.,  Flory,  W.  S.,  Ill,  and  Dickson,  R.  E., 
"Optimum  Intercept  Laws,"  US  Army  Missile  Command, 
Report  No.  RD-TR-67-10,  December  1967. 

19.  Dickson,  R.  E.,  "Optimum  Intercept  Law:  Part  II",  US 
Army  Missile  Command,  Report  No.  TR-68-12,  September 
1968. 

20.  Dickson,  R.  E.,  and  Garber,  V.,  "Optimum  Rendevous, 
Intercept  and  Injection,"  AIAA  Journal,  Vol.  7,  No.  7. 
July  1969,  pp.  1402-1403. 

21.  Dickson,  R.  E.,  "Optimal  Tracking  Laws,"  AIAA  Journal, 
Vol.  10,  No.  4,  April  1972,  pp.  534-535. 


237 


22.  Dickson,  R.E.,  "Constant  Gain  Optimal  Tracking  Laws 
for  Finite  Final  Time,"  US  Army  Missile  Command, 
Technical  Report  RD-73-10,  April  19*3. 

23.  Willems,  G.,  "Optimal  Controllers  for  Homing  Missiles 
with  Two  Time  Constants,"  US  Army  Missile  Command, 
Technical  Report  No.  RE-TR-69-20,  October  1969. 

24.  McCowan,  W.  L.,  "Investigation  of  Disturbance  Accom¬ 
modating  Controller  Design,"  US  Army  Research  and 
Development  Command,  Technical  Report  T-78-65,  3  July 
1978. 

25.  McCowan,  W.  L.,  "Investigation  of  Distrubance  Accom¬ 
modating  Controller  Application  to  A  Missile  Auto¬ 
pilot,"  US  Army  Missile  Command,  Technical  Report 
TR-T-79-63,  31  May  1979. 

26.  Malcolm,  W.  W.,  "Experimental  Study  of  Disturbance- 
Absorbing  Controllers,"  US  Army  Missile  Command, 
Technical  Report  RG-TR-71-8,  June  1971. 

27.  Malcolm,  W.  W.,  Priest,  J.  H.,  and  McTigue,  Larry  D. , 
"The  Development  of  a  Distrubance-Accommodating 
Controller  to  Reduce  'Spot  Jitter'  in  a  Precision 
Pointing  System  -  A  Practical  Design  Guide",  US  Army 
Missile  Command,  Technical  Report  TG-77-21,  July  1, 
1977. 

28.  Johnson,  C,  D.,  and  Miller,  George  Al,  "Design  of  a 
Disturbance-Accommodating  Controller  for  an  Airborne 
Pointing  Device",  Proceedings  of  the  1976  Conference  on 
Decision  and  Control,  Clearwater  Beach,  Florida,  Decem¬ 
ber  1976,  pp.,  1171-1179. 


APPENDIX  A 


AN  EXAMPLE  DESIGN  OF  A  REDUCED-ORDER 
COMPOSITE-STATE  RECONSTRUCTOR  (ESTIMATOR) 

A .  1  Introduction. 

This  Appendix  describes  an  example  design  of  a 
reduced-order  composite-state  reconstructor  (estimator)  for 
a  system  with  a  second-order  plant  and  a  second-order 
disturbance  model.  The  purpose  of  this  Appendix  is  to 
illustrate  the  design  approach  to,  and  final  form  of,  a 
composite-state  reconstructor  for  a  typical  missile 
application.  The  plant  and  disturbance  models  used  in  this 
example  correspond  to  the  missile  homing  problem  considered 
in  Section  4.3  of  Chapter  4,  with  the  exception  that  in  the 
present  case  it  is  assumed  that  the  output  y  consists  of 
only  the  one  state  element  x^  .  The  only  on-line  input 
data  available  to  the  state  reconstructor  is  the  output  y(t) 
and  the  control  u(t). 

Johnson  [5],  (36]  has  formulated  and  solved  the  problem 
of  observing  the  states  x  and  z  of  the  general  time-varying 
linear  dynamic  system 

x  «  A (t)  x  +  B (t)  ult)  +  F(t)  w ( t )  ( A-l ) 
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y  =  C(t)  x  (A-2) 

z  =  D ( t )  z  +  M ( t)  x  +  a  (t)  (A-3) 

w  ( t )  =  H (t )  z  +  L ( t )  x  ( A-4 ) 


where  x  is  an  n  x  1  plant-state  vector,  A  is  an  n  x  n  plant 

matrix,  B  is  an  n  x  r  input  matrix,  u  is  an  r  x  1  control 

vector,  F  is  an  n  x  p  disturbance  input  matrix,  w  is  a  p  x  1 

disturbance  vector,  y  is  an  m  x  1  output  vector,  z  is  a 
p  x  1  disturbance  state  vector,  D  is  a  p  x  p  disturbance 
process  matrix,  M  is  a  p  x  n  matrix,  a  is  a  sparse  sequence 
of  impulses,  H  is  a  p x  p disturbance  output  matrix  and  L  is  a 
p  x  n  matrix.  One  "recipe"  for  building  a  physically 
realizable  device  which  operates  on  the  output  y  and  the 
control  u  to  produce  estimates  of  x  and  z  is  given  by  [5], 
[38] 

u  (t) 

(A-5) 

where  all  the  matrices  may  be  time-varying,  x  and  z  are 
estimates  of  the  plant  and  disturbance  states,  and  and 
K2  are  gain  matrices  which  are  chosen  to  stabilize  the 
solution  of  Equation  A-5.  The  state  reconstructor 


Equation  A-5  has  dimension  (n  +  p).  In  a  1971  paper  [6] 
Johnson  derived  a  different  form  of  observer  for  general 
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time-varying  systems  of  the  form  Equations  A-l  -  A-4.  This 
different  state  reconstructor  has  reduced  dimension 
(n  +  P  -  m),  where  m  is  the  rank  of  the  output  matrix  C. 

The  recipe  for  this  reduced-dimension  state  reconstructor 

'  A 

may  be  stated  as  follows:  The  estimates  x  of  the  plant 

A 

state  and  z  of  the  disturbance  state  are  given  by  the 
algebraic  "assembly"  equations 

x  -  [cT  (CC1)'1  -  T12  rj  y  +  t12  c  {A~6 


z  =  t22  U  -  £  y) 

where  the  auxiliary  variable  £{t)  is  generated  on-line  by 
the  (n  +  p  -  m)  -  degree  system  (dynamic  filter) 


5  ■  ( *?  +  I  jr )  s  +  v  y  +  ft  u 


(A-8) 


» 


The  filter  (Equation  A-8)  is  driven  by  the  plant  output  y 
and  the  control  u,  and  the  matrices  in  Equations  A-6  -  A-8 
are  defined  as  follows: 

a)  The  matrices  T^2  and  T22  have  dimensions 
n  x  (n  +  p  -  m)  and  p  x  (n  +  p  -  m),  respectively,  and  are 
chosen  to  satisfy 


It  is  remarked  that  T^2  and  T22  always  exist,  are  not 
unique,  and  are  readily  computed. 


b)  The  elements  of  the  matrix  E  are  chosen  to 
satisfy  certain  stability  specifications,  as  will  be  seen  in 
the  example  to  follow. 

c) 
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a  =  (  t12  +  rc)B 


(A-13) 


C  #  =  (CCT)"1C 


( A-14 ) 


e) 


12 


«  (T 


12 


12 


+  T 


22  x22 


(A-15) 


(T 


12 


T12  + 


22  1 22 


( A-16 ) 


The  reduced-dimension  state  reconstructor  Equations 
(A-6)  through  (A-8)  produce  estimates  which  have  estimation 

A  A 

errors  ex  *  x  -  x  and  ez  *  z  -  z  given  by 
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=  x  -  x  =  T 


12 


(A-17) 


(A-18 ) 


where  the  error  variable  e  is  governed  by 


S  .  (*+£•»')  e  +  t22  o  (t) 


( A-19 ) 


where,  as  mentioned  before,  E  is  chosen  to  satisfy  the 
stability  requirement  that  e(t)  -*•  o  promptly,  from  any 
initial  condition  e  (tQ). 

A. 2  The  Design  Example 

In  this  section  we  consider  the  design  of  a 
reduced-dimension  composite-state  reconstructor  for  the 
special  case  where  the  system  matrices  have  constant 
elements  and  are  specified  as 
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(A-20 ) 


(A-21) 


C  -  [i  o] 


( A-22 ) 


(A-23 ) 


( A-24 ) 


(A-25) 


This  problem  has 


n  »  dim  A  *  2 


o  »  dim  D  -  2 


m  «  rank  C  -  1 


Hence  the  reduced-dimension  observer  has  dimension 
(n  +  p  -  m)  =3. 

The  matrices  T12  and  T22  are  respectively,  any 
nx(n+P-m)=2x3  matrix,  and  any  p(n  +  p-  m)»2x3 
matrix  satisfying 


['  1  "I  [ft] 


=  0  ;  rank 


[ft] 


We  will  choose 


0  0  0 

S3 

_  X  0  0, 

r°  1  0 

~  0  0  1 

—  « 


It  is  readily  verified  that 


[1  0  |  0  0]  i 


(A-26) 


(A-27) 


( A-28 ) 


( A-29 ) 
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rank 


0 

0_ 

1 

0 


( A-30 ) 


and  therefore  A-26  is  satisfied.  Then  we  have 


T 


12 


+ 


0  0  1 
0  0  0 
0  0  0 


(A-31) 


12 


+  T  T  m  \ 
l22  l22 


-1 


(A-32 ) 


Next,  T^2  and  T22  are  used  in  Equations  (A-1G)  and 
(A-ll)  to  find  c/  and  The  result  is 


(A-33) 


Jt  =  [  1  0  0  ] 


(A-34) 


247 


The  characteristic  matrix  of  the  error  Equation  (A-19) 


is 


(2 >  +  !.*’)  * 


1 


0 

0  1 
0  0 


which  has  eigenvalues  which  satisfy 


X3  -  X2  -  e2  X  -  z3  -  0 


which  may  be  written  as  (note:  the  £  are  all  real) 


(X  +  a)  (X  ~bX-c)  *  0 


The  roots  of  Equation  (A-36)  may  be  written 


X1  »  -  a  ;  a  >  0 


X  -  ,  X 


2  '  A3 


-I-  ’  4-V 


b  +  4c  ;  b  <  0 


where 


b  -  a  *  l. 


(A-35) 


(A-36) 


(A-37) 


(A-38) 


(A-39) 


(A-40) 
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a  b  +  c  *  Z. 


( A-41 ) 


a  c  =  Z. 


(A-42) 


For  this  problem,  the  design  parameters  a  and  b  are  chosen 
to  give  eigenvalues  with  relatively  large  negative  real 
parts  in  order  to  obtain  fast  settling  times  for  the 
estimates.  The  following  values  were  chosen: 


a  =  30 


(A-43 ) 


b  =  -42 


( A-44 ) 


C  =  -541 


( A-45 ) 


The  corresponding  eigenvalues  are 


\  -  -30 


(A-46) 


^2  9  ^3 


-21  +  j  10 


( A-47 ) 


which  yield  the  values 

»  b  -  a  »  -72 


( A-48 ) 
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^2  -  ab+c  =  -1801 


(A-49 ) 


E3  ■  ac  =  -16230 


( A-50 ) 


Next,  Equation  (A-12)  is  used  to  find 


2 

1 

1  Z2 


+ 

+ 


El£3 


3,383 

113,442 

1,168,560 


(A-51 ) 


and  Equation  (A-13)  is  used  to  compute 


fl 


(A-52) 


The  differential  equation  governing  the  auxiliary 
variable  £  is  thus  obtained  as 


1  0 
e2  0  1 

e3  0  0 


•£1  -  r2 
'll  l2  ~  l3 

■z1  e3 


( A-53 ) 


where  E i ,  E2  and  E3  are  specified  in  Equations  (A-48) 
through  (A-50). 
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When  the  parameters  of  this  example  are  substituted 
into  Equations  (A-6)  and  (A-7)  the  state  estimates  become 


(A-54) 


z 


(A-55) 


where  the  values  of  Zi,  E2  and  £3  are  specified  in 
Equations  (A-48)  through  (A-50)  and  £i»  5 2  and  53  are 
the  solutions  of  Equation  (A-53). 

A  block  diagram  of  the  final  state  reconstructor  is 
shown  in  Figure  A-l . 

If  the  gain  values  in  (A-48)  -  (A-51)  are  judged  to  be 
too  large,  they  can  be  reduced  by  making  appropriate  reduc¬ 
tions  in  the  (magnitudes  of  the)  real  parts  of  the  choosen 
roots  (A-46),  ( A-47 ) , 


APPENDIX  B 


DIGITAL  PROGRAMS  FOR  ANALYSIS  OF 
DISTURBANCE-UTILIZING  CONTROL  SYSTEMS 

B.l  Introduction. 

This  appendix  describes  the  digital  computer  programs 
used  in  Chapters  III  and  IV  to  solve  for  the  disturbance¬ 
utilizing  control  and  to  obtain  data  used  in  the  analysis  of 
its  performance.  The  basic  program,  called  DUCAT  (Distur¬ 
bance-Utilizing  Control  Analysis  Technique),  has  three 
versions:  DUCATl — for  scalar  plant/scalar  disturbance/ 

scalar  set-point  problems,  DU CAT 2 — for  zero  set-point 
problems  with  a  second-order  plant  and  a  second-order 
disturbance  model,  and  DUCAT 3 — for  zero  set-point  problems 
with  a  fourth-order  plant  and  fourth-order  disturbance  model 
(or  two  second-order  disturbance  models). 

The  DUCAT  program  can  implement  either  a  disturbance¬ 
utilizing  control  law  or,  for  comparison,  a  conventional 
linear-quadratic  control  law  for  a  time-invariant:  plant 
(2.1),  (2.2),  disturbance-command  models  (2.3),  (2.4), 

(2.6),  (2.7)  and  performance  index  (2.5).  The  time  varying 
gains  are  obtained  by  solving  the  matric  differential  equa¬ 
tions  using  Runge-Kutta  fourth-order  integration  via  ACSL 
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(Advanced  Continuous  Simulation  Language)  on  a  CDC-6600 
computer.  ACSL  is  also  used  for  integration  of  the  plant 
differential  equations.  Initial  conditions  for  the  forward 
integrations  of  the  gain  equations  are  found  by  performing 
backward-time  integrations  of  these  equations,  starting  at  a 
specified  terminal  time  T,  with  the  known  terminal 
conditions,  and  integrating  back  to  the  time  tQ  *  o.  The 
values  of  the  gains  at  t  *  o  are  then  stored,  to  be  used  as 
the  initial  conditions  for  the  subsequent  forward-time  runs. 
This  procedure  is  used  to  avoid  the  storage  requirements 
associated  with  storing  the  gain  time-functions  for  all 
o  <  t  <  T. 

An  important  feature  of  DUCAT  is  the  capability  of 
solving  for  the  "T-minimin"  values  of  the  performance  index 
J,  in  either  the  disturbance-utilizing  or  conventional 
linear-quadratic  problem.  The  values  of  J[Ti]  are 
obtained  for  a  selected  set  of  values  of  specified  terminal 
timeu  Ti  in  some  specified  interval  [Tmin,  Tmax] .  The 
program  then  selects  the  minimum  value  Jrain  among  that  set 
and  displays  the  optimal  control,  state  trajectory  and 
related  parameters  for  the  particular  Tmjn  corresponding 
to  ^min* 

The  flow  of  the  basic  DUCAT  program,  which  describes 
all  three  program  versions,  is  presented  in  Figures  B-l  and 
B-2.  Listings  of  the  three  program  versions  are  contained 
in  the  following  sections. 


256 


B.2  Program  DUCATl 


This  section  contains  the  listing  and  parameter 


definitions  for  the  DUCATl  program,  which  solves  for  a 
disturbance-utilizing  control  or  a  conventional 
linear-quadratic  control  in  regulator  problems  involving 
scalar  plant/scalar  disturbance/scalar  set-point.  Non-zero 
set-point  or  zero  set-point  regulator  problems  may  be  solved 
by  DUCATl.  Input  parameters  (determined  by  "SET"  statements 
near  the  end  of  the  program),  and  plot  output  parameters 
(identified  in  the  "PREPAR"  statement  at  the  end  of  the 


I 


program)  are  defined  below.  In  addition,  the  printed  output 
parameters  are  also  defined. 

INPUT  PARAMETERS 


PARAMETER 

DEFINITION 

ALPHAS 

a  as  defined  in  Chapter  III. 

AS 

A  as  defined  in  Chapter  III. 

BS 

B  as  defined  in  Chapter  III. 

CINTFD 

Forward-time  data  communication 
interval  (sec). 

CINTBD 

Backward-time  data  communication 
interval  (sec). 

CS 

C  as  defined  in  Chapter  III. 

CSETS 

Set-point  input  (ft). 
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CIS 

DTBCK 

DTFWD 

ES 

FS 

GS 

HS 

IALG 


QS 

RS 

SS 

TFINIT 

XSIC 


Ci  as  defined  in  Chapter  III 
( f t/sec^) . 

Integration  interval,  backward¬ 
time  (sec). 

Integration  interval,  forward¬ 
time  (sec). 

E  as  defined  in  Chapter  III. 

F  as  defined  in  Chapter  III. 

G  as  defined  in  Chapter  III. 

H  as  defined  in  Chapter  III. 

Logic  input.  Selects  fourth-order 
Runge-Kutta  integration  when 
IALG  =  5. 

Q  as  defined  in  Chapter  III. 

R  as  defined  in  Chapter  III. 

S  as  defined  in  Chapter  III. 

Maximum  value  Tmax  for  final¬ 
time  scan  (sec). 

Initial  condition  of  the  state 
x  ( f t) . 


PARAMETER 

T 

XSP 

ZSP 

KXSP 

KXCSP 

KXZSP 

KCSP 

KCZSP 

KZSP 

WSP 

VSP 

UOPTSP 

BURDSP 

ASSISP 

UTILSP 

THXZSP 


PLOT  OUTPUT  PARAMETERS 


DEFINITION 


Program  time  (sec), 
x  as  defined  in  Chapter  III. 
z  as  defined  in  Chapter  III. 
kx  as  defined  in  Chapter  III. 
kxc  as  defined  in  Chapter  III. 
kxz  as  defined  in  Chapter  III. 
kc  as  defined  in  Chapter  III. 
kC2  as  defined  in  Chapter  III. 
kz  as  defined  in  Chapter  III. 
w  as  defined  in  Chapter  III. 
Unused. 

u°  as  defined  in  Chapter  III. 

Burden  as  defined  in  Chapter  III. 

Assistance  as  defined  in  Chapter 
III. 

Utility  as  defined  in  Chapter  III. 
exz  as  defined  in  Chapter  III. 

8CZ  as  defined  in  Chapter  III. 


THCZSP 


PRINTED  OUTPUT  PARAMETERS 


PARAMETER 


DEFINITION 


KXST 

KXCST 

KX2ST 

KCST 

KC2ST 

K2ST 

TAUTAS 

JMATAB 


Stored  initial-condition  of  kx. 

Stored  initial-condition  of  kxc 

Stored  initial-condition  of  kxz 

Stored  initial-condition  of  kc. 

Stored  initial-condition  of  kC2 

Stored  initial-condition  of  k2. 

A  particular  specified  terminal 
time  T^ . 

Value  of  Se^T)  s  e(T). 


J2TAB 


J3TAB 


Value  of  H  f  eT(t)  q«(t)  dt 

o 

T 

Value  of  h  f  r  u2(t)  dt 

o 


JTFTAS  J  <T) 

XTABS  x(T). 


The  listing  of  Program  DUCATl  follows 
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DUC  A Ti 


PROGRAM  OPT G 

CTHwnrr - compute  opt itfurcoKTerocToir  cast  of  missile  tntercepi - m 

C  WITH  DISTURBANCES  PRESENT  ... 

~C  also  commute  The  minimum  j  in  a  family  of  j  s  ... 

c  then  compute  assistance  burden  and  utilization  ano  plot 

C  '  " 

INITIAL 

- ARRAY  KXSrriDg)  .K^C^Tn'S  J) . KV75T TIT01 - 

ARRAY  KCSTIIOC) .KCZsT 1100) •  X2ST (LOCI 
ARRAY  XTABSI100I 

ARRAY  JMATABdOOl  ,  J2  TAB!  ICO  »  ,J3T  A  Q  ( 1  0  0  » 

ARRAY  JTFTASUQ3) 

ARRAY  T  AUTAS ( IOC  I 


INTEGER  I.J 

INTEGER  NS 


CONSTANT  DTFHD* C . ,  TFTNTT-CY7TJTBCV-C • - 

CONSTANT  AS*0..dS-0. < CS= 0 . . CSE TS*0 . • 0S*0 . ,F S= 0 . 
CONSTANT  CIS*  0. .ALPHAS* G • 

CONSTANT  £S=0 • 

CONSTANT  GS*U.,rtS=0.,QS=L..RS*O..SS*C. 

CONSTANT  KXS*0. .KXCi=C. .KXZ S=0 . , KCS*  S..KC2S*0. .KZS*0. 

CONSTANT  KSTC-II. - 

CONSTANT  NSP*0..  flUKUSP^O.,  ASSISP=C.,  UTIlsP*0. 


logical  fmobho.last 


NS*  3 

FHS=FS*HS 
BSOR*«BS**2)/RS 
KXSIC=(CS**2) *SS 
KXCSIC*-CS*SS*GS 

- KX7STC- 0 . - 

RCSIC*«GS**i)*SS 
KCZSIC*  0. 

K2SIC*0. 

FNDBHO-. FALSE. 

LAST*. FALSE. _ 

**CONSTANT  CINTLF *0 . Ot 

CONSTANT  CINTFU* 0.1*CINT3D:C.l 
NAXT*RSN(FHOBHO,OTFRU,UTUCK) 
TSTP  =  LOO. 

UOPTS»0 . _ _ 

A  SSISS*  0 . 

THXZS-0 . 

T  HC  Z  S  *  0  . 

UTILS*0 . 

NS*0. 


v m  s  s  r.  >  ■ 

T.’J1!  '."i  ■ 

3Iv:»Ui-l.  -.N 
RSTKcri'-'i  : 


'  V  1  i!:YHIiH«| 

V^A  / 


.  . 01.TACSS'.\Ui011  DOWf  • 


kxcsp=o  . 
kxzsp=o. 
kcsp=c. 

KCZSP-O. 

KZSP=C . 

- rmr75p_Ir; - 

r  Hczspa  c • 

XSP*G. 

ZSP=t. 

UOPTSP=0. 

JNAYES*0. 

- - - 

J3*C  . 

END  I  "INITIAL" 

DYNAMIC 

CINTERV  AL  C I NT  *  0 . 1 
MAXTERVAL  NAXT=0.CC1 

- W STEPS — R5TTP3T - - 

CINTFL*RSM(LAST ,C INTLF , CINT FU» 

C I  ITT  x  R  S  H  (  FHO  6  M  D ,  C IN  T  F  L  ,  C I  NT  B  D ) 

VARIABLE  1*0. 

ALGORITHM  IA  LG*<t 

IF  (FND8HUI  GO  TO  SkPSV 

- IMI.LL.U.T  GO  TU  SKP’VY - 

NS*NS*1 
XXST  (NS )  *KXS 
KXCST (NS»*KXCS 
KXZST<N5I=KXZS 
KCST(MS»*<CS 

XCZSTINSUKC/S - 

KZST(NS»*KZS 
SKPSV.. CONTINUE 

TERMTIABS<T-TFINIT».LE.OlNTOO.ANO..NOT.FWOBWO» 
IF (FH OB HO I  TSTP=CINTBD»FLOAT(NSl 
I F ( FHD0HO)  CINT=AMIN1 (C I N I F L  ,T STP-T > 

- CONSTANT-  TGWN*Ti  T=  T~ - ~ 

TERMTIABS  JT-TSTPI .LE. T GOMN . AND ,F HQBHDI 
DERIVATIVE  OPTGN 
CALL  FTNQRV 
KXS=INTEG(KXSD.KXSICI 
KXCi*INTEGlrXCSJ,KXCSIC» 

- OZS'*TNTEGIKXZSUtKXZSlCI - 

KCS* INT  EGIKCSO*  KCSICt 
KCZS*INTE5IKCZS0.KC7S TCI 
KZS*If.TEC(KZSOtKZSIC» 

XS*INTLGtXSO,XSIC) 

JZ»IN(EG<J20OT.C.» 

- jjHTNTETTJTOCT-,  O'.T - 

TMXZS=A TAN2I-2.*KXZS»  <KZS+ 1 . t- 3o > ) *5 7 . 2 9578 
THCZS=ATAN2t-2.*KCrS, tKTS* 1 ,E- 33 I) *5 7. 295 70 
ENO  S  -DERIVATIVE- 
END  S  -DYNAMIC- 
TERMINAL 
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If  (FMUBMU.ANU.lAsTI  GO  TO  TERN 


WRITE  <6,980 1  (KXiU  1 1  ,KXCSTU),KX2STII),KCSTII),KC2ST<I».K2Sim... 
•  I* 1«NS I 

948 i •  FORMAT! U0,6E15.5> 

INTEGER  NSfNL 
NSFNL. NS 

- Ujj, - 

FMOdNO* .TRUE. 

GO  TO  SET IC 


CYCLE. .CONTINUE 

JMAVES" 0.5*«SS*CS*CS*XS*XS- 2 .• SS*CS*  GS*CSETS*XS. . . 
♦SS*GS*GS*CSETS*CSEIS) 

- JTrS.JHAVEStJTi.TJ 

JHAT  ABINSMJMAYE  S 
J2TABINS)«J2 
J3TABINS) iJ3 
XTA6S(NS)-X$ 

JTFIASINSI.JTf S 

- TlUTK5TR5lriT - 

SET IC. . NS*NS* 1 

If  INS.Gt .NSfNL I  GO  TO  FNL&UN 
RECOR.. CONTINUE 

KXSIC.KXSTINSI 

- KTCSIC*  KXCSTTNSV  ~  “  ' 

KX2SI C»  KX2ST (NS) 

KCSIC.KCSTINSI 
KC2SIC*KC2ST (NS) 

K2SIC.IC2ST  INS) 

LOG 


GO  TO  LOOP 
FNL RUN. .CONTINUE 

J2EROS* 1.E30 
DO  JMINS  1*1 .NSFNL 

IFI  J2tROS.LT.JTf  TASU  I )  GO  TO  JNINS 

- J7ER0Si"JTFTASm  ~~ 

TF2ERS*T  AUTAS II I 
NS- 1 

JNINS..  CONTINUE 
NS«b 

WRI TE  (6  , 199)  I T AUT As  I  X ) , JNA T A8 1 1 ) , J2 I ABI  I  I , J3TABI I K 

199..  fORNAT  (TlO.f  «.2»T2  .  ♦C10.<».T35,EU.b  .T50.E10.G. 
Tb5,ElJ.A,T80,ElG.4) 

REMIND  8 

last. .true. 

GO  TO  RECOR 

'TEHff.TCTJN  TT  NOT - - - 

ENO  t  "TERMINAL" 

END  8  "PROGRAN- 


I  1  r 

I t,v  \ 

Ml:".  .  •  u  .  •  '  OF  I'.'.."- 


A 

0  NOT 


Cl  o 


s 

0S«-alphas  ~ 

IF  (FMOBMO)  GO  TO  1 C  0  3 

X  ~  GEf  DERIVATIVES  FOR  BACKWARD  INTEGRATIONS 

KXSO*  TAS-8S0R*KXS>  *<XStKXS» AS* <CS*CS»*QS 
- K yCSP^T  AS-BSOE*  KX s  macs »  <  X  C  S»  E  S  -E  SI*  QS*  GS - 

KXZSO* ( AS-BSOR*  KXS T*KXZS*KX i»FHS»KXZS*OS 

kC53=2.*KCS*ES-BS0R»UKCS»kxCS1*(GS»GS»*QS 
KCZS0=KCZS*0S+ES»KCZS-KXCS* (BSOR*KXZS-FHS» 

KZSO- 2. *KZS*DS-BS0fi* (KXZS*KX  ZS  1*2  •  *F  US*  KX  ZS 
J200T*C  . 

- jjtnrnncn - 

XSO-C  . 

RETURN 

LOOP  TO  COMPUTE  X ,KX ,KX Z.KZ .UOPT , J 
10G3  CONTINUE 

x - - — - - 

X  SOI- AS*XS 
XSD2=BS*UOPTS 

C  GET  CI2TURBANCES. MISSILE  ANO  TARGET 

NS*C1S*EXP«-ALPHAS*T> 

XS03=FS*WS 

- - 

ZS*WS 

KXSO= (- AS+BSOR*KXSJ  *KXS-KXS* AS- TCS’CS) *QS 
KXC  jD  =  (-AS»8S0R*KXSI  *KXCS-*LXCS*t  S*C3  *QS*GS 
RXZS&=(-AS*BSOR*KXS1*KXZS-KXS*FHS-iCXZS»OS 
KCSJ--2.*KCS*ES*8SOR* (KXCS* KXC ST  - <GS*GS > *QS 

icczso=-r>i:czs»us*ES»KG-zsrFKict.»iHVOR»K.xzs~msi - 

KZSJ=-2.»KZS*US*BS0RMKXZS*KXZSI-2.*FHS*KXZS 
C  COMPUTE  UOPT 

OACON=i. 

UOPTS=-  (BS/RS)  *  I  KXS*XS*KXCS*C5ETS+KX  ZS*  ZS*0 ACONI 
C  COMPUTE  PERFORMANCE  INUtX  AT  T.LE.TF 

jzDaT’i.b'ms’ui'u^xS’xb-c' .*us*cs*i>s*xs*i;i>tis  “ 

C*QS*GS*GS*CSETS*CSETSI 
J JDOT=0 ,5MU0PTS*U0PTS*RS1 
IF  ( • NOT .LAST )  RETURN 

C  COMPUTE  BURDEN.  ASSISTANCE  ANO  UTILIZATION  IN  RECORO  RUN 

BURUES=Q.5*KZS*ZS*ZS 

|SSISS3.KXZS*XS*ZS-TTCZS*Ui>ETS*  ZS - 

UTILS  =  ASSISS**BURDES 
BUR DSP*  BURDE  S 
ASSISP* ASSISS 
UTILSP*UTILS 
MSP=HS 

- kesf.-kxs — 

KXCSPsKXCS 
KXZSP*KXZS 
KCSP-KCS 
KCZSP*KCZS 
KZSP=KZS 


c  *  tS 
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TMX ZSP®  THX2S 

THCTSFITHCTS 

UQPTSP*  UOPTS 

tfSP*VS 

XSPsXS 

ZSP«ZS 

ENO 


••TRANSLATION  TINE  *  4. 503*** 


r  ~ 


n  - 

p?:. 


/ 


A 

i  0:1  Ou  WCff 
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smcwiisiT.i - -  " 

StT  AS«1. 

SET  BS*i. 

StT  CINTf 0*1 • 

srr  ciNTeo=i. 

ScT  CS»1.  _  _ _ 

'SET'  c SETS* -ITT.' 

SET  ClS*-lt».l 
SET  OT8CK-0 .02 
StT  OTF*iO*Q.02 
StT  £S*0. 

SET  FS«1. _ _  _ _ 

StT  MS*1. 

StT  IAL6*S 
StT  GS*C. 

SET  RS*1. 

SET  SS»1. _  _ _ 

StT  KSIC*30. 

PREPAR  T.XSP.ZSP.KXSP  .KXCSP  .KXZjP .KSSP.KCZSP.K7SP,.. 
WSP.VSP.UOPTSP.BURUSP.ASSISP.UTUSP,  T  MXZSP,  THCZSP 


r.jCi'tu'.'-Jv'j: 


•  V .  •  VI  .'ABUS. 

i  s  '  ■■■ .  i ! *. A 

;  ,j<  Of  I'Auho  AillCli  I >0  wot 

:«115LY, 
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B.3  Program  DU CAT 2 . 

This  section  contains  a  listing  and  parameter 
definitions  for  the  DUCAT2  program  which  solves  for  a 
disturbance-utilizing  control  or  a  conventional 
linear-quadratic  control  in  the  case  of  zero  set-point 
(homing  intercept)  regulator  problems  with  a  second-order 
plant  and  a  second-order  disturbance  model.  Input 
parameters  determined  by  "SET"  statements,  and  plot  output 
parameters  identified  by  "PREPAR"  statements  at  the  end  of 
the  program,  are  defined  below.  Printed  output  parameters 
are  also  defined. 


INPUT  PARAMETERS 


PARAMETER 


DEFINITION 


A 

ALH 

AT 

B 

BBT 

C 

CINTBD 


A  as  defined  in  Chapter  IV. 
aft  as  defined  in  Chapter  IV. 
Transpose  of  A. 

B  as  defined  in  Chapter  IV. 
BBt. 

C  as  defined  in  Chapter  IV. 

Backward- time  communication 
interval  (sec). 


CINTFD 

D 

DTBCK 

DTFWD 

F 

FH 

H 

IALG 

KX 

KXZ 

KZ 

Q 

RINV 

S 

TFINIT 

VMR 

VTNIC 

VTR 

WMXTB 

WMYTB 


Forward-time  communication 
interval  (sec). 

D  as  defined  in  Chapter  IV. 

Backward-time  integration 
interval  ( sec) . 

Forward-time  integration 
interval  (sec). 

F  as  defined  in  Chapter  IV. 

FH  as  defined  in  Chapter  IV. 

H  as  defined  in  Chapter  IV. 

Logic  input.  Selects  Fourth-Order 
Runge-Kutta  integration  when 
IALG  =5. 

Kx  as  defined  in  Chapter  IV. 

Kx2  as  defined  in  Chapter  IV. 

Kz  as  defined  in  Chapter  IV. 

Q  as  defined  in  Chapter  IV. 

Inverse  of  R,  Chapter  IV. 

S  as  defined  in  Chapter  IV. 

Maximum  value  Tmax  for  final-time 
scan  (sec) . 

Missile  velocity  along  LOS  (ft/sec). 

Initial  value,  velocity  of  missile 
normal  to  LOS  (ft/sec). 

Target  velocity  along  LOS  (ft/sec). 

Missile  disturbance  input  table, 
independent  variable. 

Missile  disturbance  input  table, 
dependent  variable. 


WTXTB 

Target  disturbance  input  table, 
independent  variable. 

WTYTB 

Target  disturbance  input  table, 
dependent  variable. 

WDMXTB 

Unused . 

WDTYTB 

Unused . 

WDTXTB 

Unused . 

XIC 

Initial-condition  value  of  x  vector 

XMRIC 

Initial-condition  value  of  missile 
position  along  LOS  (ft). 

XTRIC 

Initial-condition  value  of  target 
position  along  LOS  (ft). 

XTNIC 

Initial-condition  value  of  target 
position  normal  to  LOS  (ft). 

PLOT  OUTPUT  PARAMETERS 

PARAMETER 

DEFINITION 

T 

Program  time  (sec). 

XP 

x  as  defined  in  Chapter  IV. 

ZP 

z  as  defined  in  Chapter  IV. 

KXP 

Kx  as  defined  in  Chapter  IV. 

KXZP 

Kxz  as  defined  in  Chapter  IV. 

KZP 

Kz  as  defined  in  Chapter  IV. 

W 

w  as  defined  in  Chapter  IV. 

Net  target  disturbance  (ft/sec2). 


WT 


Ik 
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WM 

BURDEN 

ASSIST 

UTIL 

JZERO 

TFZERD 

UOPTP 

XTNP 

XTRP 

XMNP 

XMRP 

THMVP 

XTP 

YTP 

XMP 

YMP 

XMD 

YMD 

XML 

YML 


Net  missile  disturbance  (ft/sec). 

Burden  as  defined  in  Chapter  IV. 

Assistance  as  defined  in  Chapter  IV. 

Utility  as  defined  in  Chapter  IV. 

Minimum  value  of  J  in  a  set  of 
Ji  values. 

Value  of  T  corresponding  to  JZERO. 

u°  as  defined  in  Chapter  IV. 

Target  position  normal  to  LOS  (ft). 

Target  position  along  LOS  (ft). 

Missile  position  normal  to  LOS  (ft). 

Missile  position  along  LOS  (ft). 

Missile  velocity  vector  angle, 
degrees. 

Target  position,  horizontal  (ft). 

Target  position,  vertical  (ft). 

Missile  position,  horizontal  (ft). 

Missile  position,  vertical  (ft). 

Missile  velocity,  horizontal 
( ft/sec ) . 

Missile  velocity,  vertical 
(ft/sec) . 

Unused . 

Unused . 


PRINTED  OUTPUT  PARAMETERS 


PARAMETER 


DEFINITION 


KXT 

KXZT 

KZT 

TAUTAB 

JMATAB 


Stored  initial-condition  of  Kx . 

Stored  initial-condition  of  KX2 

Stored  initial-condition  of  Kz. 

A  particular  specified  terminal 
time  T . 

Value  of  *5  xT(T)  Sx (T) 


J2TAB 


J3TAB 


Value  of  HI  xT(t)  Qx(t)  dt 

o 

T 

Value  of  H  f  uT(t)  Ru(t)  dt 
o 


JTFTAB 

XlTAB 

X2TAB 

EAUTAB 

EUTAB 


Value  of  J  at  t  =  T. 

xx(T)  . 

x2(T). 

EAU  as  defined  in  Chapter  IV. 
EU  as  defined  in  Chapter  IV. 


The  listing  of  Program  DUCAT2  follows 


o  o  o  o 
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DUC  A  T2 


PROGRAM  OPTG 

COMMENT  COMPUTE  OPTIMAL  CONTROL  F OR  CASE  OF  MISSILE  INTERCEPT 
WITH  DISTURBANCES  PRlSLNT 

ALSO  COMPUTE  THE  MINIMUM  J  IN  A  FAMILY  OF  J  S 
THEN  COMPUTE  ASSISTANCl  uuroen  and  utilization  ANO  PLOT 


INITIAL 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 

ARRAY 


A(2,2l,AT(2,2i,H(2,I),BT(l,2>  « BUT (2, 2), CT1, 2I.O(2,ZI 
F(2,ll,H(l,2l,FH<E,2l,KX<2,2l,KXlC<2,2)tKXZ<2,2> 

KXUOI (2,2) .KXZOOT  (2,ZI,XZ00r<2,2l,X(2,l>,Z(2,l>,U(2,2> 

S(2,2 ),V1 (2, II ,V2 (2, 1) ,V 3(2,1) ,XUOt  1(2,11 , XU  012 <2,11 

XOO T 3(2,1) , X 00 T (2,1) «XIC(2,1)  ,KXT  (2,2,1031 

KX2T  (2,2, 10u)  ,K/I  (2,2, ICQ)  «  MM  XT  H  ( t> )  ,  HMYTB  (b  I  ,NT  XTH(6) 

WTYTB(6I,XT(1,2),/T(1,2),V1,(2,1),AKA(2,2I,ARB(2,2) 

XX  BBT (2,2) , ARC (2. 2) , AKU(2,2» .ART ( 2 ,2» , ARF (2 , 2 » 

ARG(2 ,2  I  .  ARM (2, 2  I ,AKHT (2,2) , B8TXXZ(2,2)«ARI(2,2)«ARJ(2,2) 
ARJT (2,2)  , T  AUT  Art l 10  0  I «SX(2,1) ,JTFTAB(10C) 
K2(2,2>,XX2IC<2,2>,K2IC(2,2),KXZTR(2,2> 

MUMYTBIIO) ,NUMXTB(10l,HUIYTB(bl ,W0TXTB(6> 


ARRAY  XXP(Tf)  .KXZPI4)  ,  K/P ( 4  I 

ARRAY  XP(2» ,  ZP(2> ,X1 TASK  10  0) ,X2T ABI 10G) 

ARRAY  VS(2,1> 

ARRAY  JMAIAB(IOO) , J2 TAB (100 ) ,J3TAU(200>  ,E  AUT A H ( 10 0 ) , E U TAB ( 1 30 > 


INTEGER  I.J 
INTtGtR  Nj 


CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 

CONSTANT 


A-4*  0. ,6=2»0. ,C-2»  G.,0=4*C.  ,F*2*0. 

H»2»C. ,U-4*0 . ,RINV=C. ,S-4»J . ,UTBCK*0. 

OTFND-G.  .TUNIT-t.  ,KX-4*C, 
KX2««»*0.,K/»<,*J.,MMXTB»e»*C..NMYTB»b*G. 

N*6.,HU-0. 

WTKTB=6*  3  ,.RTYTB=b*0. 

XIC=2*0. 

XMR I C*  0 ,  , XTR IC*0. , VMR-li.  , VT  R*0 . , VMN-C . ,VTN*0 . 
VMNIC=L . ,\MNIC-G.,  XNNIC-0  .  .XINlC-0  . 

NOMY  TB-lC’u. ,NOMXT B*lC*G.,HOTYTB=b*G.,HUTXTB-o*0. 
ALH-0. 


LOGICAL  FRUBMO.LAST 


NS- J 

00  BNUIC  I>1,2 
00  BNOIC  J-1,2 
KXIC (I,J)=S(I ,J) 

KXZ IC ( l , J)«0. 

KZIC ( I, Jl -0. 

8NDIC.. CONTINUE 

CALM«COS(ALM*O.OlZ4S» 
SALM«SIN(ALH*0.01Z4S> 
FMOBNU-  .FALSE. 


LAST*. FALSI. 

LOOP. .CONI I  NO t 

CONSTANT  CINTLF*0.G.‘ 

CONSTANT  C1NTFO*0.1.CINI»U- 0.1 
N  AX  T*  RSN  (F  NUBNU.  llTF  NO.  UTtlOW 

UOPT*0< 0 
BORDEN  ■  0 • C 
ASSIST  *  O.C 
UTIL  ■  0.3 
N  *  0.0 

no-0. 

NT  «  0.0 
NH  •  0.0 
CONSTANT  2*2*0. 

TSTP  •  ICC. 

KXPUMG.O 
KXP(2)*0.J 
X  XP  <  3 » *  0 . 0 

kxp(«*»*o.o 

KXZPtl) *0.0 

KX2PC2T >0.0 
K  X/P ( J  T  *0.0 
KXZPUT  *5.0 

Kjpm-o.i 

KZP ( 2  I  *  0 . 0 

KZP (31*0.0 
K  ZP  (*•  T  •  0  •  0 
XP(1»*0 .0 

XP( 21*0.0 

zp(i»*o  .o 

ZP( 21 *0 . C 
UOPTP*Q  .0 
J2»  0 . 

J  J*  0 , 

EUTAll-C . 

£ AUT AH*  0. 

J2S*0  • 

J2P*  0  • 

J3P«0. 

£UP*C. 

£  AUP*0. 

JNAY£R*C. 

NL-0. 

T  L*  0  . 

X INP*  0 . 

X  TRP*  0 . 

X  NNP*  0 . 

XHRP*0 . 

X  TP *0 . 

YTP*0. 

XNP»0 . 

Y  HP  *  0  . 

X  HL  *  0  . 

Y  ML  *  0  • 

T  MMVP*fl . 


XMO*0. 

YHO*0 • 

END  S  “INITIAL** 

dynamic 

CINTERVAL  CINT-0.1 

maxterval  haxt*o.q:i 
NSTEPS  NSTP=1 

C INTFL»RSHILAST .CINTLF .CINTFD) 
CINT*RSN<FH0BH0,CIN1  FL.CINT  BU) 

VARIABLE  T*C  • 

ALGORITHM  IALG^ 

IF  ( F H08H0)  GO  TO  SKPSV 
IFIT.LE.O.)  GO  TO  SKPsV 
NS«NS*1 

00  SVLOOP  1-1.2 
00  SVLOOP  0*1*2 
KXT ( I » J  *NS) *KX ( I »  J ) 

KXZTII, J.NS)*KXZ< I.JI 
KZT(I,J.NS)=KZ(I .J) 

SVLOOP. .CONTINUE 

GO  TO  SKPOER 
SKPSV. .CONTINUE 

HU*RSH<  T  .EU.O..O.. »H-HL)/<T-Tl*1.E-20I) 

HL*H 

TL*T 

TERMT ( ABSIT-TFlNI I ) .LE.CIN1  BO, ANO . .NOT .FHUBHO) 
I F (FWDBND)  TSTP-CINTBU*FLOAT  INS> 

I F  ( FHUBHO  CINT  =  AMINHCINTFL,TSTP-T» 

CONSTANT  TG0MN=l.E-3 
TERMT (A BS (T-TSTP) .Lt. T  GO MN.ANU. FHUBHO) 

DERIVATIVE  OP  TON 
CALL  FTNURV 
KX=INTVC<  KXUO  T . KX IC ) 
kxz*intvc<kxzoot,kxzici 
KZ«INTVC<KZOOT,KZICI 
X*INTVC(XUOT.XIC) 

J2*INTEG(J2UOT»3.) 

J3*INTEU(J300T,C.) 

eu*integieuoot,o.) 

eau-integieauoot.o.i 

VTN=INTEG«MT,VTNIC) 

XTN*INTEGTVTN,XTNIC) 

END  *  -DERIVATIVE- 
END  S  -DYNAMIC- 
TERMINAL 

IF  IFHOBHO. ANO. LAST)  GO  TO  TERM 
IF  (FHDBHD)  GO  TO  CYCLE 

HRITE  (bill)  I  (  IKXTI 1 1 . JJ.KK) »KXZT (I  I . JJ.KKI « 
KZTIII.JJ.KK).II-1.2) .JO* 1.2) »KK  *  1 »N  S) 
98..  FORMA T C  T23.3E 15.5) 

INTEGER  NSFNL 
NSF NL  *NS 
NS«0 

FH09H0=.TRUE. 


GO  TO  S£TIC 
CYCLE.. CONTINUE 

00  JTl  1-1.2 
JTl..  XT|t,I)>X(I,l) 

CALL  MMPY IS. X.SX, 2.2.1) 

SCH*0.0 
00  JT2  1*1,2 

JT2 • .  SCN*SCM*XT ll,I)*SX(I,l> 

JNAYER*0«5*SCH 

JTF*JMAVER«J2*J3 

JHAT ABINSMJMAYER 

J2TABINSI*J2 

J3TABINS)*J3 

EUTABINSI*EU 

EAUTAd(NSI*EAU 

XlTABINSUXtl.ll 

X2TABtNS)*Xf2,l) 

JTFTAB(NS)*JTF 
T  AUTABINS)  *  T 

SETIC..NS=NS+1 

IF  (NS.GT.NSFNL)  GO  TO  FNLRUN 
RECOR..  00  IC1  J=  1  *  2 
10  IC1  1*1.2 
KXIC(I.J) *KXT (I.J.NSI 
KX2IC(I , J)*KX  ZT ( I.J.NSI 
KZICl I, J>*KZT  <1, J.Nil 
IC1.. CONTINUE 
LOG 

GO  TO  LOOP 
FNLRUN. .CONTINUE 
JZER0*1 «E30 
00  JN IN  I=1,NSFNL 

IF  IJZERO.LT. JTFTABIII I  GO  TO  JMIN 

JZER0*JTFTABIII 

TFZtRO  *  TAUTABII) 

NS*  I 

JMIN.. CONTINUE 
NS*9 

MRI TE  (6 .299)  ITAUTABII)  .JNATAB  (I)  .J2TABII)  .J3TABI II  *  ... 

JTFTABIII  ,  XI  TAB  (I )  .X2TABII)  .EAUTA  Bf  1 1,  EU  TABID.  1*1,  NSFNLI 
299..  FORMATIT4,F4.2,T12,E10.4,T26,E1G.4,T40,E10.4,... 

TS4,Eli).4,T68«£l0.4,T8Z.E10.4,T96,E10.4,T110,E10<4) 

REMIND  8 
LAST*. TRUE. 

GO  TO  RECOR 
TERN. .CONTINUE 
END  S  “TERMINAL" 

ENO  S  “PROGRAM" 


uoo  u  oo  oo  o  o  o 


subroutine  ftnqrv 

s 

IF  (FMOBMO)  GO  TO  ICOJ 
CALL  HNPV  <KX,A,ARA,2,2,2> 

CALL  HHPV  (AT,KX,ARd,2,2,2) 

CALL  HHPV  UX,BBT,KXBBT, 2,2,2) 
CALL  HHPV  IKXBBT ,KX , ARC . 2. 2 , 2> 
CALL  HHPV  (KXB8T ,KXZ,AR0,2 ,2,2» 
CALL  HNPV  (AT ,KX Z , ARE » 2 , 2 » 2  1 
CALL  HHPV  <KXZ,U,ARF,2,2,2» 

CALL  HHFV  (KX ,FH, ARC. 2 ,2 ,2> 

CALL  HHPV  (KZ,0,AKH,2,2,2> 

CALL  HHPV  <BBT,KXZ,B3TKXZ,2,2,2> 
OO  5  J*l,2 
OC  5  1-1,2 

•t  KXZTRd,UI*KXZ(J,I» 

CALL  HHPV(KXZTR,BBTKXZ,ARI, 2,2  ,2» 
CALL  HHPV  (KXZTR,FH,ARJ,2,2,2) 

OO  b  J*  1 ,2 
OO  6  I*  1,2 
ARNTII. JI*ARH(J,I» 

b  ARJTII, J>»ARJ(J,I) 


GET  DERIVATIVES  FOR  8ACKNAR0  INTEGRATIONS 
OO  10  J  *  1,2 
UO  10  1*1,2 

KXOOT(I  ,  J)*ARA(  I,  Jl*  ARBd,  JI-ARCII  ,J»*RINV»Qd,0) 
KX200T(I,JI»ARG(I , J > ♦ ARF < I , J I ♦ ARE (I , JI-ARDI I , JI’RINV 
K200T 11 ,J)  * ARJI1 ,0) tARHIl , J)«ARJT II .  J> ♦ARHTd ,J) -ARI I I ,J) *RINV 
1G  CONTINUE 

J200T-0. 

J300T*0 . 

£UDOT*0 . 

E AUUOT*  0 • 

OO  20  1-1.2 
00  20  J*l,2 
2C  XOOT (I,J)*0. 

RETURN 

LOOP  TO  COHPUTt  X,  KX, KXZ, KZ ,UOPT  ,  J 
1003  CONTINUE 

SET  UP  TO  COHPUTE 
CALL  HHPV(A,X,X00T1,2,2,1) 

OO  100  1*1,2 

IOC  XOOT?  (I  ,l)*Bd,  l)*UOPT 


GET  0I2TURBANCES,HISSILE  ANO  TARGET 
M INOH*0 « 

I F (T  . L T  .1.7.0R.T . G T ,2,51  GO  TO  1001 
NlNi)H*32.2*S2NI3,92?*(T-1.7ll#SlN(3.92?MT-l.?M 


ooo  o  o  o  o  o  o  oo  o  o  o 
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1001  continue 

N M*NINUM«32 • 2*C ALH 


GET  COMPOSITE  DISTURBANCE 
NT*). 

N*NM-NT 
DO  101  1*1,2 

101  X  C0T3  (I  ,1 )*f (l,lt*M 

00  1G2  1*1,2 

102  XOOT (I, 1I*XD0T1 ( I ,11 ♦XOOTc ( 1 , 1 » ♦XUOT 3 ( 1 , 1 1 

2  (1 , 1 ) *  N 

OfcT  DISTURBANCE  DERIVATIVES,  MISSILE  AND  TARGET 
l (2 , 1 1  *  NO 
XWR*XMRIC*VMR*T 
XTR*XTRIC»VTR*T 
VMN*VTN*X(2,lt 
XMN*XTN*X(1,1) 


SET  UP  FOR  KX  »  KXZ , KZ  FORNARO  INTEGRATIONS 
CALL  MM PY  (KX,A,ARA«2,2«2) 

CALL  MMPY(AT,KX, ARB,2,2,2I 
CALL  MMPY IKX , BBT , KXBB  T  ,2,2, 2) 

CALL  MMPYIKXB8T ,  KX .ARC, 2 ,2,21 
CALL  MMPY (KX BBT ,KX2,ARO,2.2,2l 
CALL  MMPYUT.KXZ, ARE, 2,2,21 
CALL  MM PY(KXZ«0,ARF, 2*2,21 
CALL  MMPYIKX,FM,ARG,2,2,2I 
CALL  MMFY(K2,0,ARH,2,2,2> 

CALL  MMPY (BBT ,KXZ,BBTKXZ<2,2,2) 

DO  105  J* 1 , 2 
00  105  1*1,2 

105  KXZTRII ,J)*KXZ(J,I> 

CALL  MMPYIKXZTR.BBTKXZ, ARI,2,2,2» 

CALL  MM PV(KX2TR,FH,ARJ,2,2,2) 

00  U6  J*l,2 
00  106  1*1,2 
ARHTd,  JI=ARH(J,I> 

106  ARJT (I, J)*ARJ  (J,I  ) 


GET  DERIVATIVES  FOR  FORNARO  INTEGRA! ION 
OC  11C  J*l«2 
JO  113  1*1,2 

KXOOUI  ,J»*-ARA«I  ,J»-ARH(1  ,  J>*ARCII,  J»*RINV-aiI,J> 

KXZJOT  < I,U)*-ARG(I,J) -ARFII , Jl -ARE (I ,J) ♦AROlI ,JI*RINV 
KZOOTd ,J)«-ARJ(I, J)-ARN(I , J)-ARJI (I ,  1  > - ARM T ( I , J > *AR II I , J » *R I NV 
11C  CONTINUE 


COMPUTE  UOPT 

CALL  MMFY(KX,X»V1»2»2,1I 
CALL  MMPV(KXZ«2,V2,2.2«1) 


o  o  o 


k 
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00  12?  1*1.2 

12C  V3<I,ll*Vl(I,ll«V2U,ll 
U  SC* 0 .  b 
00  121  1*1.2 

121  USC*USC*B(I,ll*V3<Itll 
U0PT*-RlNW*USC 


COMPUTE  PERFORM ANCt  INU^*  AT  T.LE.TF 
CALL  MHFV(Q.k.tf3,2,2,ll 
00  122  1*1,2 

122  J2S*JlS«X ( I ,1 )»VS  1 1 ,1 > 

J200T* j.9*J2S 

J30  JT*J  .5»U0PT**2/  t  1  NO  ♦l.£-2:  I 
EU00T*J3O0T*KINi/ 

£  AO  JOT  *  3URT  (  OOP  T»  JOPT  ) 

IF  (.NOT. LAST)  RFTUkN 
C  COMPUTE  8UR0EN,  ASSISTANCE  ANO  UTILIZATION  IN  RECORD  RUN 

CALL  MripY(KZ,Z,V4«2,2«ll 
BSC  *  C  .  3 
OC  21 C  1=1.2 

2  1C  B  SC  *  U  SC  *  2  1 1 «  1 1  *  X  4  1 1 , 1 1 
UORJEN  *  3  .t>* BSC 
CALL  MmPYIKXZ, 2, V*.  ,2,2,11 
A  SC  *  0 . 0 
00  23 C  1*1,2 

2  30  ASC*ASC»X(I,1)*V4(I,1) 

ASSIST.-ASC 

otil*assist-buroen 
X  t*xtr*calh»xtn*salm 
yt*-xtr*salh*xtn*calm 

XM*XNR*CALM*XHN*SAlH 

VP*  XNN*  C ALH-XNR*  S AL  H 

XMO*VMR*CALM*VMN*SAlM 

V  MO  * VMN  *C ALM - VMK*  3 ALH 

XH0*XN0«l.E-2w 

THNW*ATAN2(VH0,XH0?*SF.29‘>8 

THHVP*  T  HMV 

XTP*XT 

vtp*vt 

XMP*XN 

YMP*VM 

KXPl 1 1  *  KX (1 « 1 1 
KXP ( 21 *KX  (2,1 ) 

K  XP ( 3 ) * KX (1 , 2  > 

K  XP  (4 1  * KX (2 , 2 ) 

KXZPt It  *KXZ  ( 1,1) 

KXZP(2)*KXZ(2<1) 

KXZP(3I«KXZI1,2) 

KX2P (4) aKXZIZ ,21 
K  ZP ( 1 1 *KZ (1, 1 1 
K ZP ( 2 1  * KZ (2, 1 1 
KZPI3t*KZ(l,2) 

KZP(4)aKZ(2,2l 
XPI 1) *X  11,11 


X  P  <  2 1 1 X  <2,11 

ZPt 1 I *2  U»l> 

2P< >»-2  <2.1» 

l)OPTP*UOPT 

XtNPsXlN 

XTRP*XTR 

XMNP=XHf» 

X  MRP*  XM  R 
E  NO 

••TRANolAIION  TIMt 


f 
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St T 
StT 

SET  AT*4. 0,1.0, 

StT  B«i.,l. 

Set  UtlT  tli 

StT  C« l  .  L  .  0 . [ 
it!  CINTFO«C.‘' 

StT  C IN  T  80*  C  .  t> 

StT 

StT  OTBCK*0 . t 2 
StT  OTFhO«O.C2 
StT  FO.Ltl.C 
StT  M*l.C,0.t 

StT 

StT  IALG«S 

StT 

StT  Kt/itllQlCaC  |C«C|J*0 
StT  KtRC*%CtCla«U«  .4 
StT  U*g»tiO«CiQ*C*^«3 
StT  RlNV»i. 

StT  S«5C.,0.»C.,li. 

SET  TFlNIT«b« 

StT  VNR*ZCOC. 

SET  VTNIC*0. 

SeT  VTR»C. 

StT  NHXT6~0*lli«*I*SS*i«t.  t  a  iX  a  a 
StT  NNVTBWT.R.-OT.R.-'U.u.-'U.C.-tT.R.'ZT.R 
StT  nTXTB«0.0,  l.C,  2.5,  2.1,  J.  C ,  4.0 
StT  NTYTB-O.C,  C.G,  Q  «J  .  b  4  .  4  ,  b  4 , 4  *  t>  4 . 
StT  NONXTfl  »  0. 2 , : . 1 1 .1.0,2 . L.2.C  1 . 3. E , S. Cl  ,  3. 1 
StT  NOT  >  TIT  1  J.0,-*w,b44.,o44,.C.t,j.C 
SET  NUTkTtl  ■  J.  J  ,  2..  ,«.  .  jl,2 .1,2. 11 .4  .  C 

StT  xic*j:o.,3, 

set  xnrio-sc*;. 

SET  XTRIC*0. 

sit  xtnic*o. 

PREPAR  T.XP.2P.KXP,*XZP,K/P,N,NT,NN, 

BUR JEN, ASSIST, UTIL«J2tR0,TFZER0«UUPTP 

PREPAR  XTNP,XTRP,XNNP,XNRP 

PREPAR  THNVP 

P RE PAR  XTP,YTP,XMP,YNP 

PREPAR  XNO.YNU 

PREPAR  XHL.YNL 


•3.11,4.0 


B.4  Program  DUCATJ 


This  section  contains  a  listing  and  parameter 
definitions  for  the  DU CAT 3  program  which  solves  for  a 
disturbance-utilizing  control  or  a  conventional  linear- 
quadratic  control  in  the  case  of  zero  set-point  problems 
with  a  fourth-order  plant  and  fourth-order  disturbance  model 
(or  two  second-order  disturbance  models).  Input  parameters 
determined  by  "SET"  statements,  and  plot  output  parameters 
identified  by  "PREPAR"  statements  at  the  end  of  the  program, 
are  defined  below.  Printed  output  parameters  are  also 
defined. 


INPUT  PARAMETERS 


PARAMETER 


DEFINITION 


A 

AT 

B 

BT 

CDZXT 

CDZYT 


A  as  defined  in  Chapter  IV. 
Transpose  of  A. 

B  as  defined  in  Chapter  IV. 
Transpose  of  B. 

Drag  coefficient  table,  independent 
parameter . 

Drag  coefficient  table,  dependent 
parameter. 


CINTBD 


Backward-time  communication 
interval  (sec). 


CINTFD 
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D 

DRAGC 

DTBCK 

DTFWD 

F 

FH 

H 

IALG 

MMXT 

MMYT 

R 

RINV 


Forward-time  communication 
interval  (sec). 

D  as  defined  in  Chapter  IV. 

Drag  constant ,  h  p  SmCQ 
as  in  Chapter  IV. 

Backward-time  integration 
interval  (sec). 

Forward-time  integration 
interval  ( sec  )  . 

F  as  defined  in  Chapter  IV. 

FH  as  defined  in  Chapter  IV. 

H  as  defined  in  Chapter  IV. 

Logic  input.  Selects  fourth-order 
Runqe-Kutta  integration  when 
IALG  -  5. 

Missile  mass  table,  independent 
parameter  (  time  ) . 

Missile  mass  table,  dependent 
parameter  (slugs). 

R  as  defined  in  chapter  IV. 

Inverse  of  R. 


S  S  as  defined  in  Chapter  IV. 

TFINIT  Maximum  value  Tmax  for  final¬ 

time  scan  (sec). 


TMANXT 

Target  maneuver  disturbance 
independent  variable. 

table. 

TMANYT 

Target  maneuver  disturbance 

table. 

dependent  variable  (ft/sec2 

). 

TWN1YT 

Horizontal  target  wind  disturbance 
table,  dependent  variable 
(ft/sec2 ) . 
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TWN3YT 

TWN3XT 

VS 

WND3XT 

WND3YT 

XIC 

XTlIC 

XT2IC 

XT3IC 

XT4IC 


PARAMETER 

T 

XP 

ZP 


Vertical  target  wind  disturbance 
table,  dependent  variable 
( ft/sec2 ) . 

Vertical  target  wind  disturbance 
table,  independent  variable. 

Velocity  of  sound,  low  altitude 
(ft/  >ec) . 

Vertical  missile  wind  disturbance 
table,  independent  variable. 

Vertical  missile  wind  disturbance 
table,  dependent  variable 
( ft/sec2 ) . 

Initial  condition  of  x. 

Initial  condition  of  horizontal 
target  position  (ft). 

Initial  condition  of  horizontal 
target  velocity  (ft/sec). 

Initial  condition  of  vertical 
target  position  (ft). 

Initial  condition  of  vertical 
target  velocity  (ft/sec). 


PLOT  OUTPUT  PARAMETERS 


DEFINITION 


Program  time  (sec), 
x  as  defined  in  Chapter  IV. 
z  as  defined  in  Chapter  IV. 
Kx  as  defined  in  Chapter  IV. 


KXP 


KXZP 

Kxz  as  defined  in  Chapter  IV. 

W1P 

as  defined  in  Chapter  IV. 

W2P 

w2  as  defined  in  Chapter  IV. 

UOPTP 

u°  as  defined  in  Chapter  IV. 

UTIL 

Utility  as  defined  in  Chapter  IV. 

BURDEN 

Burden  as  defined  in  Chapter  IV. 

ASSIST 

Assistance  as  defined  in  Chapter  IV. 

CDZP 

Drag  coefficient  C^  as  in 

Chapter  IV. 

MMP 

Missile  mass  (slugs)  as  in 

Chapter  IV. 

DM 

Base  drag  of  missile  (ft/sec2). 

Dl 

Horizontal  component  of  DM. 

D2 

Vertical  component  of  DM. 

THMANP 

Angle  of  target  maneuver  force 
relative  to  ground  (degrees). 

VELTP 

Target  velocity  magnitude  (ft/sec). 

VELMP 

Missile  velocity  magnitude 
( ft/sec) . 

TMANP 

Target  maneuver  acceleration 
magnitude  (ft/sec2). 

ULONGP 

Missile  control  force, 
longitudinal  (pounds). 

ULATP 

Missile  control  force, 
lateral  (pounds). 

UOPTAP 

Missile  control  force, 
resultant  (pounds). 

WIND1 


Horizontal  missile  wind  disturbance 
acceleration  (ft/sec2). 


WIND2 


WNDT1P 

WNDT2P 

XM1P 

XM3P 

XT1P 

XT3P 

THMP 

THTP 

XT2P 

XT4P 

XM2P 

XM4P 
XT 2 DTP 

XT 4 DTP 


Vert ical  missile  wind  disturbance 
acceleration  (ft/sec2). 

Horizontal  target  wind  disturbance 
acceleration  (ft/sec2). 

Vertical  target  wind  disturbance 
acceleration  (ft/sec2). 

Horizontal  missile  position  (ft). 

Vertical  missile  position  (ft). 

Horizontal  target  position  (ft). 

Vertical  target  position  (ft). 

Missile  velocity  vector  angle 
(degrees). 

Target  velocity  vector  angle 
(degrees). 

Horizontal  target  velocity  (ft/sec). 

Vertical  target  velocity  (ft/sec). 

Horizontal  missile  velocity 
( ft/sec ) . 

Vertical  missile  velocity  (ft/sec). 

Horizontal  target  acceleration 
( ft/sec2 ) . 


Vertical  target  acceleration 
(ft/sec2) . 


285 


PRINTED  OUTPUT  PARAMETERS 


PARAMETER 


DEFINITION 


KXT 

KX2T 

K2T 

TAUTAB 

JMATAB 


Stored  initial-condition  of  Kx. 

Stored  initial-condition  of  Kxz 

Stored  initial-condition  of  Kz. 

A  particular  specified  terminal 
time  T^. 

Value  of  *5  xT(T)  Sx(T) 


J2TAB 


J3TAB 


Value  of  *5  /  xT(t)  Qx(t)  dt 

0 

T 

Value  of  *S  /  uT(t)  Ru(t)  dt 

o 


JTFTAB 

X1TAB 

X3TAB 

EAUTAB 

EUTAB 


Value  of  J  at  t  *  T. 
xi(T) . 

X3 (T) . 

EAU  as  defined  in  Chapter  IV. 
EU  as  defined  in  Chapter  IV. 


The  listing  of  Program  DU CAT 3  follows 


Ducat  3 


PROGRAM  OPT  G 

COMMENT  COMPuTt  OPTIMAL  COrTEGE  FOR  CASE  OF  MISSILE  INTERCEPT'  "  . 
C 

INITIAL 

ARR*Y  AlmiUAKxl-t-liA-UmmiAKUotH)  ,  AR  J  (  A  ,4 )  .  ARE  (4  ,  *.  I 

ARRAY  ARC  1  <*.,<« ) 

ARRAY  ARFW,*.)  ,kKo  (•,,<,)  ,ARrt<4,4)  ,ARmT  (4,4>  ,AR  H4, 4  I  ,ARJ(4,4T 

ARRAY  AKIlU.sl 

ARRAY  APJT  (*.,■♦)  .AxKI-..^)  « tt  I  <•*»•*)  .  b  1*.  ,  Z )  ,  bK  INW  (4  .  2  I  ,  OT  (  i  ,  4  ) 

ARRAY  CuZXTT7) ,CDZY7 T7) 

ARRAY  U  (•«,<« )  « UM  xT  (<♦  I  iuM  Y  T  (  4 )  »  F  ( 4  ,  c  >  ,FH(‘*»4l»M(2»4l 

ARRAY  JTFTAaliC)  ,X'XU,*>  ,KXIC(*,4i  ,KXP <■*,•♦)  ,KXT  (4,4,10 
ARRAY  JMATAbTiEI  »JXTAol*..)tJATAii(i.)  ,tAUTAd(l.),EUTAB(13) 

ARRAY  KX  COT (4«4i 

ArRmY  KXZ  (<♦,**  I  .aauN.tl  ,KX/pU  ,4)  .XXZT  U'4,13)  ,<XZTR(h,4> 

ARRAY  KXZUOf 

Array  <Z(-,*.l 

array  KZuOT  t*,  ,•») 

ARRaY  KZiCi',,'.)  |KZP(h**+)  ,KZT  ,U(4,4),0X(4,..),R42,2) 

array  nmxt(:i  ,,'Tmyt{:» 

ARRAY  RINV  ( *.,«.  )  ,K  IN  RUT  C-  ,4»  . PUOPT  Uixit  i(t«4l 

ARRAY  TH«NXT<4)  .TMA.lYTUi 
ARRAY  T AUT Alj  <  I C  ) 

ARRAY  ThNlXT(o) , T«N. YT ( o J , T RN3XT ( 6 »  »THN3YT(6) 

array  ul.pt  u,i>  .uoptpu  ,ii  .v: (•*.  n  .  yz  (■*, n  .V3U.  11 , Y4<<»,  11 

ARRAY  Y5U,a)  ' 

ARRAY  RNU3XH6)  .WNU3YT  (o» 

array  xu.n ♦xicc-.,i),x-'(4,*j,xiTAaa:»  .xttabuu) 

ARRAY  XUCT (4,1) 

A’RRA'Y  “XuOTi  T4 . 1TVX00TE  (4 ,U  ,XuOT  3 (4 ,1 > 

ARRAY  Z(4,il •EPI4.1I 


XNTHrGER  T,J 
InTEo-R  Ho 
INTEGER  NSFNL 

IHT.-0-R  NcKfcl  ,N:.Ri\2,N_Krc.3,Nc.RN-*,NcRRS>  , Nt RRd , NE KR 7 , NE RR8 , Nl PR9 


CONSTANT  A=i6*C.  , ST^lo*: . , 3- B* J.  ,37^ 6*0 ., D= 16*0 . 
CONSTANT  uJZxT  =  7*;  .,CoZYW*„. 

CONSTANT  CJ7P-: . 

CONSTANT  J(1XT=h*  .  ,i>HYT  =  t*v  • 

CONSTANT  Orf=  ^  •  , L)i -  3 •  ?ETZ- ■- • 

CONSTANT  DRAGC=*. 

CONSTANT  3T3C K= - • , u7 Fro — o • 

CONSTANT  F  =  8*u«,FH=*.6*S,,OR‘»V=3o»t,H  =  <J*C. 

CONSTANT  RXii6*3.,iCXZ-Ao*..  ,KZ=16*:. 

CONSTANT  MAChP= . . 

CONSTANT  Vl».rfP='."  ' 

CONSTANT  MMxT=5*L.,.4NYT-5*.. 

CONSTANT  0=16*0.  ,-R=h*7.  ,RIN\/-4*%  .  ,S=16*i  . 

CON  3  T  AN  T  TFINlT=Z.w 

CONSTANT  THANP^rr,T7mi7TP=:  .  ,RiP* 3.  ,W ZP=i . ,VE17P= C . 
CONSTANT  T(1AN=..  .  ,  TMANXT=H*..,  IflANYT  =  ■♦*;. 


REPRODUCE  LEGIBLY. 


I 


CONSTANT  lNNiXI-o*;. .iMlUVt 
CONSTANT  TwnoXT  =  o*;.,TnnJ»I 
CONSTANT  JOt-TAf'-t. 

CONSTANT  OLuNcP=. . .ulATP=  . 
CUNjIaNI  Vj-w. 

CONSTANT  a01= .. »Huc  =  w.  • 

C  GNS I  AN  I  tilNuls  _  .  .  UlN^i2-  '.  .  n  1=  u. 


CONSTANT  aIU»  ..  »Hiu  =  w  * 

constant  wiNu,i-,..#NiNtj2i'.fWi-w.#rt/-L» 
CONSTANT  nN CSTtT-b*  '  . »  NnOSYT  =  o*  S. 

L'GNilANT  WN.iT  IP- L  .  .ANut^H-i  . 


CONSTANT  nN CSST-b* ' . » NnOSYT =i 
CONSTANT  WNuTlP-u. ,HNuTLH-i . 
CONSTANT  XIC=a*.. 

t '  . TAJ  C  T  AMT  ¥  T  »  11-  .  .  V  i  <  1  I'  •  .  _  ¥  ' 


CONSTANT  XIC  =  A*  . . 

CONSTANT  xTllC—  ...XiSlC~»>«.XTbi,C  —  l..XT*tlc~Q. 
CONSTANT  XTIDOTaI. ,XTaDOT=' . 

C  ON j I  AN  I  XUUTP-..  .  .XThDTP-.  . 

constant  xicP*i .,xTAPi:r,xhAp*sr.;>(M<.ps;. 

CONSTANT  XM1P-C . ,XMSP-»  ..XI iP-0. ,XTSP= J. ,  THHP-J., 


TMTP- j. 


cOCICAl  FhouWu.lAST 


NS=  - 

00  JWulC  I-l.A 
00  dHOIC  J=i»A 
KXIC1I, J)=S(1.J) 
ax/  led  . 

KZica,ji=r; 

8M0IC. . CONTINUE 

FHOJHO= .FAlSY . 

L**ST=.F  ALSl. 

LOOP. .CON T I  NO t 

constant  cinTlF^l.i:/ 

CONSTANT  ClNTFO^L.r.CrMTTlCi-.i 
NmXT-kSM(FHOuhO.OTFhOiUTOCK) 

constant  UOPT-C*C. 

bORJLN  *  . . W 

ASSIST  *  ;.t 

util  -  c.- 

CONSTANT  XsV*T.'  "" -  "  - 

CONSTANT  /=*«*». 

TSTP  *  i:c .  “ 

CONSTANT  *XP*ito*b . ,N.X/P  =  lo* ..«K/P»io*U 
CONSTANT  XF=A*J.,7Pi¥*Tr. 

CONSTANT  UOPTP=<!*„  .  _ 

J2*  j  .  . 


J  J*  J  . 

E AO-C • 

£0*  j  • 

J2S-C. 

JMAYiii* ».  • 

Tl*0. 
NACN* . • 
MM*.  • 

HI* .  . 

N  2*  .  . 

H 1L  =  L  . 


w<:l=>.  . 
h  jr~«.  * 

H02  =  i  . 

XTl=XTilo 
X  T2  =  X  Tc Io 
XT3=X131C 

xTc=x  wic 

Xrti  =  xIC  (i,i)*XTi 

XM2=XIC(2,1)+XT2 

XN3=XIC (3*1) ♦XT 3 

XM4=XIC  (•*  *  1 )  ♦  XT<* 

END  $  "INITIAL** 

DYNAMIC 

CINTlRUAI.  CI«T  =  i..i' 

MAXTLRVAl  flAXI  s l  •  v  .  1 
N  ST  IP  .3  Ni>TP=i 

CINTFL=R3rt(LAST  ,  C  I N1  LI-  , u 1NT  F  u) 

CINT=RSN  (FWDBRD  * C INTFL *  CIt<T  Bill 
VARIaoLl  T-*.. 

ALGORITHM  IALG=4  -  ...  . 

IF  ( F hJ bwu)  Gu  10  j<PjY 
IFCT.lE.C.T  GO  TO  3KPSV 

N j=HS*l 

00  SVlOOP  1=1,4 
JO  iW LOOP  J=l,4 
kxT(i ,j ,us) :kku ,'jr  ' 

KXZDl  ,  J,NS)  =NXZ  (I  ,J) 

KZT 1 1 , J  «NSI=kX(  I  *  j) 

SVLOOP. .CONTlNuc 

1*0  TO  SkPDck 
SKP  3V  •  •  CON  TIN  Uc. 

"  W  Oi  =  R  SR  t  T .  cu . .  V  VC  *  *'(  R 1  -WIT. )  /  ( T-TL ) ) 

H  02=  R3W ( T . . ..»C.»(H^-h2l)/(T-TL) ) 

«IL=S1 

M2L=Wc 

Tl=T 

SKP  Lit  R»  .CONTlNuc 

TtRMT  (ABSTT-TFINITI  .  LI .  GINm .  AND.  .NOT  .FWDBHD  > 
IF(FWudHu)  ToIPiClNI du*FLuA 1 (NS) 

IF(FHDBMD)  CINT= AHIN1 (CTNTFL ,TSTP-TV 
CONSTANT  TGOMN=l.i-o 
TERHT  C  A BS  ( T-TSTPI  . LL. TGOMN  .TSNO. FNOBHD)  ' 

OcRIVA T  I V c  OPTuN 

CALL  FTnDRV  '  - 

KX=INTVC(KXUUT,KXIC) 

KXZ  =  INTVCTKXZOOT,i<XZn:y 
kZ=INTVC(KZ00T,KZ1C) 

X  =  I;-tTvC<XcaT,XIO) 

J2=INTcG(J2C0T, J . I 
J3=InT:.G(j30oT^£  .  j 
£4U=lNTCG(tAOD0T*..) 

£U*INTIGr:UDOT, :. ) 

X  T2=  INT  cG  (X  t  cuO  I  tXTc'Iu) 
xT«*=1NTE&TXT4D0T  ,  XT <*101 
XTi  =  INTLG(XTt.«XTliC) 


x:  * .  •  •  i  '  ■  \ '  r !  cable. 

TITF  C"r\  ■.  -V1  .  A Tf'.-T.  A  y 

3 1 G N 1 1  i ; '  >  ::  3  EH  OF  PAGED  WHICH  DO  BOX 

REPRODUCE  L2GIBLY. 
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XT3*lNTtC(XT<,,XI31L) 

XHl*X ( 1  ,11 ♦XT i 
XMJ-X (3 ,11* aI  3 
Xrt2*x<Z,i)*XTE 
X M4  =  x  u  ,i|Uls 
END  i  "Uti'.IVAl  1 V  E  “ 

ENU  t  "uYNAMIC" 

TERMINAL 

IF  (F  HjUFiu.mNu.LAjT  t  oO  10  ItKM 
IF  (FhjBmj)  Go  To  CyClc 

WRITE  ( b , S8)  (((KX1  (I1,JJ,il4),KXZT  ( 1  1  ,  J  J  ,  \K  )  , 

<ZT<II,JJ,«M  ,1 1*  1 ,  *j  t  Jjs  1  ,<« i  tXK-1  f NS) 
98..  FCRNATITtv»3tlG.t>l 

NSFNL-NS  ' 

NS*  . 

F  MO Jhj-  .  TSjl • 
oO  To  St  T 1C 
CYCLE.. CONTI Nut 

CALL  NMFY<S,X,$X,*.,*,.I 
SCM- w  . w 
DO  Jl  „  1*1, h 

JT2..  SCH*GCM*xa,l»»iX  (T.l) 

JMAYlh*  l  .'■•SCM 

JTF*JMAYER*J2*J3 

JMATAU(NS)*JMAYtK 

J2TAb<Ns)*Jt  "  "  . . 

J JT AbtNSI *J3 
E AUTA  T(  NSi =  ZAo 
lUT  Ab (n S I *cU 
X iTAG(NS>-X<i,ll 
X3T4b(NSI*K(3,ll 

JlFTAG(Ni.)*jTr  — . 

TAUTAU(NS)  *  I 

SE T  IC. .  NS  j*  1 

IF  O.a.GT.NSFNL)  GO  TO  FNIRUN 
RtCUN  .  ,  OJ  IC  1  J*  1,4 

00  ICi  I  =  1  ,V  - 

KXlo(I,J)=KXT (1 , J,No» 

KXZICCI  ,J»*KXZTU,J,NSV 
K  ZIC ( 1 , J i *KZT (i , J,Nj) 

ICl , .CONTINUE  . ■  . 

LOG 


bj  TO  LOOM 

FNLRUN. .CONTINUE  “  “ 

JZERO*!  .tiO 

00  JH IN  I*r7NSFNL - 

IF  ( JZtRO.Ll . JTFTABCI) »  GO  TO  JNlN 

JZERX3*JTFTABTTI - -  ~  " 

TFZlKO  *  TAUTAOU) 

NG*I 

jhin. .Continue 

No*o 

MRI  ft  To  ,299)  (TAoIAo(i)  ,JMA)Atl(II  «JCTAG(I),J31AB(I)« 


i 

I 

I 


•  •  • 


290 


JIFF  At) li )  (XllAd(l)  .  X  i  ( •«  J  ( 1 )  » . AU  f  A  d ( i )  ,  cU  I  A  o  ( I )  tl-l.NSFNL) 

299..  F0RMAT(TH,Ft.2,Ti: ,~r: .v.t’g.h::  .a.uc.ei:. 

I  I  fcl  .  .  *.  .Tod  *  L  1  .  .  *.  «  I  Oil.  ..  1  .  ...I  «  L  1  *.  .  **  «  [  1  L 

R  c  H I  i»  j  6 
L  Ai>T-  .1  rioo . 

00  To  SECuft 

TEKM..00NT I Not. 

END  $  "T£xH INAL" 

ENO  *  “RRUORArt" 


,  .  rv  » 

t  ,  .  ,  .  v  ■'  '  ‘  .  \ 

nur’  ? •  ...  Ml  i:0  NOT 

X'.V:'  '  ''  ,  i  ;  ;  m  •  "•“u> 

of  '  '  ' 

•  (  • 


oclo  oo  od  o  ono 
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SUBROUTINE-  FTnORV 
IF  (f ROERl)  GO  TO  1.0  3 

00  a  J=1.4 
DO  a  1'iti 

i,  KXZfk  (I  ,  J»=KXZ  ( j,  I) 

CALL  MMPY  TKX,A,aTTA,4',4,,» 

C ALu  MMPY  (AT  |KA  tlRDiN  t1*  t**l 
CALL  NHPY(3V*rNV,3RX(W,4,Z,2l 
CALL  MMPY  (  6k  1 N  V  tdl  tfikKt'ticftl 
CALL  MMPYrKJC,SRX,ARCl,4,4,4i 
UO  4  J= 1,4 

00  a  1=1,4  . 

4  ARO(I  ,  J  )  =  ARLi  <1  ,J) 

CALL  HHPYYARITI.RT, ARC, 4,4Y4T~ 
CALL  MMFYIAfcD.KXZ, A*D,4  ,4,41 
CALL  MMPYTKXTTRVAkX,  ARITIV.A  ,41 
CALL  MMPY(ARli,KXZ,ARI,4,4,4) 
CALL  MMPY(Kfx7TR»FH,ARj,4*4*4) 
CALL  MMPY  <AT,<XZ,A*E,4,4,4< 
call  MMPY  TXX7, uVARF, 4 i4,4y  " 

CALc  MMPY  (KX , F H , ARu »  4  *4  *  4I 
CALL  MMPY"(K2,0,ARWr,V,4V  ~ 

DO  o  J=  1  ,4 
UO  o  1=1,4 
ARHT (1,J)=AkH(J,1) 

6  A  RJ  T  ( I ,  JT  =AR  JTJ7I1 


GET  uEkI V ATI  vt  S  FOr,  BaCKMARO  INTEGRATIONS 
0  0  *  J  J  =  1 ,4 

UO  .»£  1  =  1,4 

KXOOT (r7JT='AKA~(I«  JT*AK3TiyJT  -  ARC (1,11)  . . — . 

KXZJOI  (  I  ,J)  =  AKG1I,  Jt  ♦ARFU,  j»*ARt(I,  JT-ARUCI,  J» 

RZOOT  (I,  JT  A'ffRJTTT J7V  STFrTTI ,~  JT*ffRJTTI  ,  J>  ♦ARHTfl,  JJ-URTri,  JT  " 

11  CONTINUE 


JZDOT  =  0 . 

J  3D0T=  w  • 
fcAJt»OT  =  L  4 
&  OOO T=u  • 

00  Zt  i=1.4 

2C  X00TTr,  lT  =  C.  — 

RETURN 


LOOP  TL  COMPUTl  A , KX , KXZ , KZ ,UOP T  ,J 

L0C3  CONTTWJX  -  - - 

SET  UP  T&-C0MFUT: - - -  ' 

CALL  HMPY(A,X,XU0T1,4,4,1) _ _ 


GtT  OISTUKBANCcS,  MISSIEc  AND  TARGET 


D-f^Y  v T  IS  ”v  ■' T  -;U'r  A  'TICABL&. 

!.'!••  rej-Y  1.  T  'Mri.  I  v  .  .  MA’Hlw  A 

SIGNIFICANT  NUMBKil  OF  PAGES  WHICH  DO  ROT 
iTSPRODl'CE  LEGIBLY. 


noon  non 
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TTAii=T/(IFiM1*. 

wtLMi;anr<XMc*x  4c  ♦*•><.  *5t*-*i  ♦  :.t  : 

NACrtsVtLM/Y:i 

call  ini_kP<mac«,coix i ,:.o:v  i ,7 ,luz .McRri,) 

CAL-  HUrPO  TA  j.MMaI  ,  •  ,c  tMM.N.Fi.  7) 

UM=JK4oL»WcLM»y(-Lrt*v.oJ/MM 

lii*UM*XMt/VtLn 

Ols-Ui 

U2*L)M»XML/VlLH 

U<!=  -0  4.' 

i  f  (  I  tlA'4S  k  I 

If  (  I  ,l»T  .  l.l.ANj.  T.Lv.  .  l.ul  TM  AN-  c&6.  *t  -281.  t> 

iMf.or.i.oi  tnan>:<m. 

XT2  —  XT2*i.L  —  a. 

THT-A1ANc(xTsfXli.) 

THAN:  T*An*1.<_-2: 

THMAN=T  hT  +  1  .ti  7t  »*  «  ll.At./ oUl-  1  4  TM An*  TMAN I  I 

CALl  lNlLA^(T)AtifThi<ixT  itiCtMNbTltNERRA) 

CALL  InTcRFMI  rAJ,T*«,.jxT  iTR.icYl  ,  d  ,  a  , A  NuT 2  t  Nfc RR 9 ) 

H  NO  tc.  -u  • 

IF(I  *L(  *li  /  *CX«1  tul  i^iS)  Li  O  TO  1  u  1 

A  INCH-  32.2’SIN<3.9’7* (T-; . 7)) *3IN (3  .92  7*  (T-1.7H 

M  iNUA  -N  INJM»  aMh/W^L  *i 

WINo2-rfIW0H*XM2/V£L.4 

WINJ1=-HIN0a 

111  C0t4TlNUt  "" 

XT2J4)T*hNjTi*  i»Uk  T  4 1  n An*  THAN )  *C0;>  O  hH  An) 

X T40CT=WNuTc ♦  3.1RT  (TRAh*  THAN  )  (TrtHAN) 
Ai*AlNUi*lJl-XTcJOT 

H2=AlN02*u2-uRA4/-XT.,DuT 
C  ui  t  0 1  iT LK  b AnCl.  ...L-vIVAt  wtb 

Z(l,i)  =  Wi  . . . 

c(2,ll=M0i 
Z  43 . a  t  s he 

l N i i)sAJc 


uir  CCrtP(J31T2  DICTbRuAXI 

CALL  HMPY(Fh,c,  AllOto,*,**,*) 

00  A  t  <_  I  *  A  «  C 

lie  *ii)T  111  1  )sX(jOT1  a  «ll  ♦XOJTit  I  ,1 )  txuot  oil  ,1 ) 


stT  UR  FOR  KX**Xc,*Z  FOkHArO  INfcGKATIUNS 

do  ivG  j=:.v 

00  U  : >  I  *  a  t ** 

115  KXZTRII  ,  J) sKX 2 1  J  « I ) 

CALL  1NFY  (KX»A(ArA. >•••*.•») 

CALL  MiIPY  (AT  «KX  «  ARC  t  A  «s  ) 

CALL  IK4RT|d,hlNY,UKlNV.A,c.t) 

CALL  MRPY(dRlNW,BT,ARK,L,2,4) 

CALl.  MNFY  4KX  ixRXiAFU  ,4  ,h,h  I 
00  12a  js a t L 
00  1.4  I  *  i.  1 4 


■\ 

■  N'T 


o  o  o  ooo  uoo 
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104  ARJ)  I  ,  J  )=,*kCi  1 1  ,  J) 

CALL  .-tMPmRCI,iOirA“C,4,4,4> 
CALL  MMPY4ARu,K,XZ,A.\u,.,,4,.,> 
CALl  MHPYTIOCZTA,ARK,A1ai,-,4,4l 
CALL  MMPY4AKll,KXZ,ARi,i,,4,-.> 
CALL  MMpY<KX2TK,Frt,.,ftj,4,.,,0 

Call  m.-ipy  i a t  ,kxz,a-£, 4) 

CALi.  MNP?  IKXZ,3,ASF.«..'4,4| 

CALL  MNP r  (KA,Fi4 

CALl,  MMPY  <Kr,0 , ARH, 4 , 4 ,4) 

U  0  1i.'j  J'.is 
U  0  1 C  6  T  =  1 , 4 
ARM  I 4 l,JI=ARH4J,I) 

116  ARJT  ( I  *  J)”- AplJ  (‘j,  1 1 


OcT  Uckl  V  A T  I Y  £  b>  FOk  FOkhARLi  INTEGRATION 
00  11  .  J - l ,4 

UO  .1-  1=1,4 

KXlIOT  (I  ,  J  >  =  - ARA (  1  *  J)  -  LRd  1 1  *  j  >  ♦  AkC  (  I  «  J  )  -0(1,0) 

KXZl)CT(  I,J)=-ARG  (l ,J) -ARF II  ,w) -AKi_(1,J)*ARU(I,J) 

K2UJT  II,J)=-ARu<l,“Ji-rtilMll,  JJ-ARJTU  «ok  -ARHT  (I.J)  ♦ARIM,J» 
111  CONTINUc 


COMPUT-.  UOPT 

CALL  .MMPYIKX.X.t/l, 4,4,1) 

CALL  MflPYTkXT.Z,  VZ, 4t •**”!) 

UO  lev  1-1,4 

120  v j( r , i) -vi mz rwz n,: y 

CALL  fIMPY  (R1N  V  ,  dT  , RiN Vd )  ,  e  »  2  ,4) 
CALL  MMPY (ft’U'i’VQT *Y3*UCPT*e*4,f) 
UOPTti,l)=-UGPTU.l) 
U0PT(2,ir=-u0Prf27Ii 


CGMPOU  PERFORMANCE  INolX  AT  T.LE.TF 
CALL  .WPY  1RTU0PT ,  RUOPT  i  2 , 2 , 1}'  - 

V  UO  Ti  =  0  . 

JO  2Z5  T=r,~T - 

2L5  VUOTl  =  «uOTi40UPMI,l)*RoOPt  11,1) 

j3ooT=r.3^Mri -  ~ 

CALL  NMPY<U,X,aX,4,4,l» 

Tud72*r.  "  . . 

00  20o  Ial,4 _  _ 

J200T=j  ,5*VOOT2 

V  00  T3  =  u'» 

00  2(7  1=1,2 

2isr  vu(rn=vxiOT3ruOPTTr,"iT*\joprir,iT 
LUUuT= 3 ,5*VC0T3 

XHZ^XfiTFi.E^ZS - - 

THM  =  ATAN2(XM4,XPI2) 

THHP=  TRTi*57  ,Z  ^58 

ULONO=OOPT ( 1 , 1 ) *C0$ ( ThMI ♦UOPT(2,i) *SIMTHN> 


i  i  '  '  i  V  1 1)4  '  iX-- 

"  .  '  1  .  '■  .  •  i  A  •  V..  A 

-  ■  : !  '■  "  :  OF  i  MILS  .VH1CH  DO  »0t 


ULAT=U0P1 42,  i)*UG;>  4 I  MM)  -UuP  !  4.  ,1>*.»IMThNI 
t  AUDO'T  =  2’.  (  iiiRTI  JluNu'uluiiu)  ♦  jukt  (JlAI*ulAI it 

If  (.NUIauAbT)  RLTUn-N 

C  CONPUT.  OokUlN  «  -SbliTAuCt  A.<D  UTILIZATION  IN  RECORD  RUN 

CALu  MMPY 4K2 ,2,  24,4,4,1) 

asc=c . : 

UO  21  v  I  -  a.  *  *4 

21 C  BSC  =  B3C-f  Z  4l ,  1 )  *  24  4  I  *  1 ) 

JuRJcN  -  a,>*ujU 

CALl  HrtPY  (KXZ«Z  * V-4  *•♦  ♦•« ,  i)  ■'  .  _  -  . 

A  SC  -  a  a 

oo  23:  i=:.i.  . 

2  3C  AiCsAiC  +  XU,ll*HH(I,i> 

A  SSI  ST=  -A3C  .  ‘  *  -  . 

0TlL=A3SijT-oURU2N 
DO  2  32  I  —  —  * l 
UO  23l  J=l,4 

zsz  KxPti ,j i-Kx a , j i 

KXZP (I , J) =KXZ (I ,J> 

KZP(1,J)=kZ4I,J) 

UO  234  1  =  1,4 
u C  2j4  j= i. 4 
ZP(I ,1) =Z(I,i) 

234  XP(I,l)=X(I,i) 

U3PTP(l,:)*uOPT(l,l) 

UOPTP(i",f>=UOPYP(i,i)*Mrt  .  . 

UOPTP42  ,.)=UOPT (2,1) 

UUPTP  12  ,1>=U0PTP(2,.> »Mtf 

UOP  T  AP=  SORT  luOPf  (a.  ,.)  *UOPl  (  1,1)*UUPI  4l,1)*U0PT  (2,1)  » 

U0PTAP=UUPTAP»MH 

ulOngp=Ulonc*mm 

UlATP=ULAT*MH  . 

X  T 1P=  XT  1 

XT3P=  XT  3  - 

THTP=TriT*5Z.285d 

XH1?=XM1  - 

XN3P-XN3 

WNOTlP’sKROTl"  . . “ .  '  ' 

H NO  T 2P=  HNu  T c 

CJZP=COZ  _  _  -  - 

MNP=MN 

l/cLNP*»ELH  . . 

MACHP=MACH 

THHANP*TflMAN*37.'2'^o' . . 

TMAnP=TMAN 

V  EL  TP=Sa«TTxrL»xT2TxT^XT4T~ 

X  T2P  =  XT 2 
X  T4P= XT  4  "" 

xi2P=XN2 

XN4P=XH4  *"  . .  -  . 

41P=H1 

W2P*W2  --  - 

XT2jTP=XT2uGT 

xT4UTP=)fr,jor  - - -  — 

£N0 

••TRANSLATION  TINt  =  7,2  3 ■)*** 


IHI5T  T)fr:nrvv r  r- 


’.VBLE, 


*. t‘‘ :  iE.  Of  FAC Eo  f'vtUCIi  IX)  MOT 
«KPRODUC£  LEGIBLY. 
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3-T  A  - 


ScT  AT-  .«  •  1*>h  •  i  .  •  •  .  •  i.  h  u  «f.  <  i  ••• 

. .  .  . . . 

iwT  o  -  !• 

i  t  t  U  l  - 

ScT 

Sc.!  t  •  ***37  * . *3^3  t  * • I  31 

ScT  CINTdj=w«3 
ScT  ClNTFd-. »2 

S  _  T  b  -  .  t  |  1  .  «  i  .  »  !•«  .  f»  •  tv  t  f.  *»  *  •  • 

.t.M.vtC.ti.. 

SET  u\AuC- C • I » 27 C  3 

ScT  Ol  duK”  w  *  w  l 

z:i  UTF*D^..c 

S«T  F =  w«ti»^tl*tw*t>*tv»il*ti«> 

SlT  Frl-  I«tii>t»*t  *«i*i'-*tC»tot«  v  t  < 

I  tit  Jt.  •  fwlfbt  ».  « 

3J  h:  ;,3t!  ttw.t^t.  .t^tv  m  v 

SlT  IAlo-‘j 

S  i  T  HH)(  T**  <ttki2‘Jt.tyf.t7^tAti 
ScT  MMYT  =  ^1.4,^S.5t8o,t;iU.*.t^.i' 

3  IT  »ti» 

ScT  ^iNVxi«tCtf.ttlt 

jc  T  j>lL.«ivitlif.tt^it%tt.ttl*t  ••• 

v  t t  #«  t tv  «  I  t •  • *v  <  |  .  I 

acT  TFIN1T=5. 

S  c.  T  T MANX  I *c  •  »t  •  i? »  .  « o  1 1 1 
ScT  T MA nY T  =  *  •  t .  •  t  *  lt’8#  t *  1  £ 8  • 

ScT  l^*Utr  =  ,,,..»v  .1 
S  lT  T  NN  1XT  s  C  «  t  0  t  i  t  L  •  2  «  j  •  iy.t^ti'v 
3cT  ThN3Yr=L  •  tv  if3_tct"ic«^t.  •  «  C  • 

S  lT  T  WN  3XT — v§  tvtStitSiUtoSt  .  »7?t I  •  • 

SwT  V  3*1  I'M* 

5  l T  h Nj 3xT  =  C  1 1  •  j  i  ^  t .  »o  t  <  to*;  u  1 7y  tl  t  v 

3  c  T  MNU3Y  f  ttCttvttCtt-tt.t 
J  L,  T  X  iU  X*9U  V  l  •  t  3  -  .  V  t  f  .  W  .  J  t  f  .  • 

ScT  XT  1 IC  =  u • 

set  xT2ic=-i::s.  - 

3cl  XT3  10=45.  *w* 

SET  XT4TC=l. 

PKtKAK  TtXP,ZPfKXP,*XZPtK^P  ,  hiP  ,  fc  cP  t  uuP  F P  ,  J  T I L  »B0 RJEN  «  ASS  I 3  T 
PrttPAR  CDTPfHMP  ~  ’ 

P*EPAk  CHtOitUE 

PREPAR  THHARPiVELTPf VEL^P iTMANP 

PrttPA*  ULONbPfUcATP 

PREPAR  I^CPTAP 

PREPmR  HINDI «  HlNOt 

PRtPAk 

PKEPAK  XMlPtXM3PfXl lP,xr3p, f  HMP  ?  T  H  f  P 
PREPAR  XTZP,*THp,x>iZP*X>UP 
PrfE Par  XTJUTP»XTajTP 


T:*lSD(VirH5-vT  Is-  „Fs.,  .... 
7  i'.'w-v 


rr-u.v,V 


v.  ,.v  r  ■ 


OF  KA> 


i'”y. 
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